Jul 24 14:22:15.474876 ip-10-0-132-253 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 14:22:15.939376 ip-10-0-132-253 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:15.939376 ip-10-0-132-253 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 14:22:15.939376 ip-10-0-132-253 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:15.939376 ip-10-0-132-253 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 14:22:15.939376 ip-10-0-132-253 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 14:22:15.942280 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.942082    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 14:22:15.947429 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947408    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.947429 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947430    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947435    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947439    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947442    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947445    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947447    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947450    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947453    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947456    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947459    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947462    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947465    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947467    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947470    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947472    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947475    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947478    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947480    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947489    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947492    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.947509 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947495    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947497    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947500    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947507    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947512    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947515    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947518    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947520    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947523    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947526    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947529    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947531    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947534    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947537    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947539    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947542    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947544    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947547    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947549    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.948007 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947552    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947567    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947570    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947572    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947574    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947577    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947580    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947583    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947586    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947589    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947591    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947595    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947599    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947602    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947606    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947609    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947612    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947615    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947618    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.948492 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947621    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947624    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947627    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947630    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947632    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947635    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947639    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947641    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947644    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947649    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947652    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947655    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947658    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947661    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947664    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947666    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947669    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947671    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947674    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947676    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.949013 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947679    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947682    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947685    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947688    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947690    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947692    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947695    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947698    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947700    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947703    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947706    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947708    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947711    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947714    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947716    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947719    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947721    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947724    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.947727    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948474    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.949502 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948480    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948483    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948486    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948489    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948492    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948494    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948497    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948500    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948503    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948506    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948508    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948512    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948514    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948517    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948520    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948522    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948525    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948527    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948530    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.950053 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948533    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948536    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948538    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948541    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948543    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948546    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948549    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948551    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948573    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948578    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948582    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948585    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948588    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948590    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948594    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948596    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948600    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948603    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948606    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948609    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.950527 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948611    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948614    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948616    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948619    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948622    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948625    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948628    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948630    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948633    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948635    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948638    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948641    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948644    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948646    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948649    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948652    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948654    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948657    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948659    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948662    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.951184 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948665    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948667    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948671    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948676    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948679    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948682    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948686    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948688    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948691    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948694    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948696    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948699    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948702    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948704    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948707    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948709    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948713    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948715    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948718    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.951711 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948720    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948724    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948727    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948730    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948732    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948736    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948739    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948741    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948744    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948747    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948750    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948752    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948755    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948757    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948760    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948762    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948765    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948767    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948769    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.952176 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.948772    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949181    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949187    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949190    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949193    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949197    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949199    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949202    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949205    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949207    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949210    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949213    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949215    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949218    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949221    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949223    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949227    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949229    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949232    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949235    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.952664 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949237    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949240    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949242    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949246    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949250    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949253    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949256    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949260    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949263    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949266    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949268    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949271    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949274    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949277    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949281    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949283    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949285    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949288    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.953185 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949291    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949293    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949296    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949299    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949301    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949304    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949306    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949309    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949311    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949315    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949317    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949320    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949322    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949324    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949327    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949329    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949332    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949334    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949337    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949339    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.953633 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949342    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949344    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949346    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949348    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949351    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949353    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949355    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949358    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949360    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949363    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949365    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949368    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949370    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949373    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949376    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949379    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949382    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949384    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949386    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949389    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.954143 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949391    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949394    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949396    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949399    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949401    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949403    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949406    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949408    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949410    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949413    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949415    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949418    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949421    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949423    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949425    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949428    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949430    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949432    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949435    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949437    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.954651 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949440    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.949442    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949529    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949537    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949544    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949548    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949567    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949571    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949575    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949580    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949583    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949585    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949589    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949592    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949595    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949599    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949602    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949608    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949610    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949613    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949618    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949621    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949624    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949627    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 14:22:15.955134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949631    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949634    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949637    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949640    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949643    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949646    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949649    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949652    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949655    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949658    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949662    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949665    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949667    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949670    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949673    2560 flags.go:64] FLAG: --enable-server="true"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949677    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949682    2560 flags.go:64] FLAG: --event-burst="100"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949685    2560 flags.go:64] FLAG: --event-qps="50"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949688    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949691    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949694    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949699    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949702    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949705    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949708    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 24 14:22:15.955738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949712    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949715    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949718    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949721    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949724    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949727    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949729    2560 flags.go:64] FLAG: --feature-gates=""
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949733    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949736    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949739    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949743    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949746    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949749    2560 flags.go:64] FLAG: --help="false"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949752    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949755    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949758    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949760    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949763    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949767    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949769    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949772    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949775    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949777    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 14:22:15.956384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949780    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949784    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949786    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949789    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949792    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949796    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949799    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949802    2560 flags.go:64] FLAG: --lock-file=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949805    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949809    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949812    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949817    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949820    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949823    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949826    2560 flags.go:64] FLAG: --logging-format="text"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949828    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949832    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949834    2560 flags.go:64] FLAG: --manifest-url=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949837    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949841    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949844    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949848    2560 flags.go:64] FLAG: --max-pods="110"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949851    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949854    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949856    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 14:22:15.957048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949859    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949862    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949866    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949869    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949877    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949880    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949882    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949885    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949889    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949894    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949897    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949900    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949903    2560 flags.go:64] FLAG: --port="10250"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949908    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949910    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0087b0426f3f750f3"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949914    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949918    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949921    2560 flags.go:64] FLAG: --register-node="true"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949924    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949927    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949931    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949933    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949936    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949940    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949943    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 14:22:15.957730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949946    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949949    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949952    2560 flags.go:64] FLAG: --runonce="false"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949955    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949958    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949961    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949964    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949967    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949970    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949973    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949976    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949978    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949981    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949984    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949986    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949989    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949993    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.949995    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950001    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950003    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950007    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950011    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950013    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950021    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950024    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 14:22:15.958355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950026    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950029    2560 flags.go:64] FLAG: --v="2"
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950033    2560 flags.go:64] FLAG: --version="false"
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950037    2560 flags.go:64] FLAG: --vmodule=""
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950041    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.950044    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950161    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950165    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950168    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950171    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950173    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950176    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950178    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950181    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950183    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950186    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950188    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950191    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950193    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950196    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950199    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.958992 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950201    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950204    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950206    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950209    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950212    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950214    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950218    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950221    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950224    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950227    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950230    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950234    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950237    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950240    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950243    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950246    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950249    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950251    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950254    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.959514 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950257    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950259    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950262    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950264    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950266    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950269    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950271    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950274    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950276    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950279    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950281    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950284    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950289    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950291    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950293    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950296    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950299    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950301    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950306    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.960039 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950308    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950310    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950316    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950320    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950323    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950325    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950327    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950330    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950332    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950335    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950337    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950340    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950342    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950345    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950347    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950357    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950360    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950363    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950367    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.960533 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950370    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950373    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950376    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950379    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950381    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950384    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950386    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950389    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950391    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950394    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950396    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950400    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950404    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950407    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950410    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950414    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950416    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950419    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950422    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950424    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.961111 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950427    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950429    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950431    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950434    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950436    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.950439    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.951428    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.958925    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.958944    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.958962    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.958968    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959028    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959033    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959036    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959039    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.961606 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959042    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959045    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959048    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959050    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959053    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959056    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959058    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959061    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959064    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959071    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959073    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959077    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959080    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959083    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959085    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959090    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959092    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959095    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959098    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.961981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959100    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959103    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959105    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959108    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959110    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959113    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959116    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959118    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959121    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959123    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959126    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959128    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959131    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959133    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959137    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959141    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959144    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959147    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959150    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.962479 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959152    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959154    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959158    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959163    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959167    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959170    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959173    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959175    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959178    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959180    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959183    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959185    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959188    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959190    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959193    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959195    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959198    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959200    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959203    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.962953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959206    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959208    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959211    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959213    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959215    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959218    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959220    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959223    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959225    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959227    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959230    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959233    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959235    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959237    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959240    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959242    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959245    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959249    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959251    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.963414 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959254    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959257    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959259    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959261    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959264    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959267    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959269    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959272    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959274    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959276    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959279    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959282    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959284    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959286    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959291    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959294    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959296    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.963949 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959299    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.959305    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959421    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959426    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959429    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959432    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959435    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959437    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959440    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959442    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959445    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959449    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959453    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959457    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 14:22:15.964354 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959461    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959464    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959467    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959469    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959472    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959474    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959476    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959479    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959481    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959485    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959488    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959491    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959494    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959496    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959499    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959502    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959504    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959506    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959509    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 14:22:15.964776 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959511    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959514    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959516    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959519    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959522    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959524    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959527    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959530    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959532    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959535    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959537    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959539    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959542    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959546    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959549    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959552    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959571    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959575    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959577    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959580    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 14:22:15.965246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959582    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959585    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959587    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959590    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959593    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959595    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959597    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959600    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959602    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959605    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959607    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959610    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959613    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959616    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959619    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959621    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959623    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959626    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959630    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959634    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 14:22:15.965736 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959656    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959659    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959662    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959665    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959668    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959671    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959676    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959679    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959682    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959684    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959687    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959690    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959692    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959694    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959699    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959702    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959704    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959707    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959710    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959712    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 14:22:15.966217 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959714    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959717    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959719    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959722    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959725    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959727    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959730    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:15.959732    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.959737    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.959891    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.962232    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.963847    2560 server.go:1019] "Starting client certificate rotation"
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.963967    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:22:15.966731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.964009    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 14:22:15.968092 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.968060    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:22:15.971958 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.971927    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 14:22:15.985061 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.985037    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 24 14:22:15.987683 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.987666    2560 log.go:25] "Validated CRI v1 image API"
Jul 24 14:22:15.988670 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.988654    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 14:22:15.993193 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.993168    2560 fs.go:135] Filesystem UUIDs: map[201f2c81-b159-43e4-ba0d-718fa98ae9a8:/dev/nvme0n1p4 4439a7dc-aa7c-4710-90fd-b8ab30537c86:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 24 14:22:15.993296 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.993192    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 14:22:15.999038 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.998887    2560 manager.go:216] Machine: {Timestamp:2026-07-24 14:22:15.997475409 +0000 UTC m=+0.385495517 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103780 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a72894b9bbe5af61e3855ff1688bb SystemUUID:ec2a7289-4b9b-be5a-f61e-3855ff1688bb BootID:81e974de-549d-4006-8539-36b3a2c707a8 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:19:ef:b9:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:19:ef:b9:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:80:7f:e1:2a:25 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 14:22:15.999038 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.999022    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 14:22:15.999234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:15.999153    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 14:22:16.000026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.000006    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:22:16.003029 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.002998    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 14:22:16.003183 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.003033    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 14:22:16.003867 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.003857    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 14:22:16.003908 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.003870    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 14:22:16.003908 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.003879    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:22:16.005707 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.005694    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 14:22:16.007412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.007401    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 14:22:16.009426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009411    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:22:16.009575 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009551    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 14:22:16.009616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009600    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 14:22:16.009647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009614    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 14:22:16.009647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009627    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 14:22:16.009647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009639    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 24 14:22:16.009723 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.009649    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 14:22:16.010056 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.010042    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:22:16.010088 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.010065    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 14:22:16.012569 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.012539    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 14:22:16.015401 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.015386    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 14:22:16.015451 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.015418    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 14:22:16.017526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017513    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 14:22:16.017582 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017532    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 14:22:16.017582 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017538    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 14:22:16.017582 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017543    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 14:22:16.017582 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017576    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017585    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017598    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017607    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017615    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017621    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017636    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 14:22:16.017692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.017641    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 14:22:16.018080 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.018047    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:16.018173 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.018087    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:16.019614 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.019601    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 14:22:16.019660 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.019616    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 14:22:16.022857 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.022844    2560 server.go:1268] "Started kubelet"
Jul 24 14:22:16.023026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.022970    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 14:22:16.023093 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.023010    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 14:22:16.023093 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.023048    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 14:22:16.023806 ip-10-0-132-253 systemd[1]: Started Kubernetes Kubelet.
Jul 24 14:22:16.027514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.027488    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 14:22:16.027514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.027506    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:16.028673 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.028653    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 14:22:16.032441 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.032415    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hfdt"
Jul 24 14:22:16.033809 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.033777    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 14:22:16.037890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.037869    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 14:22:16.038002 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.037873    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 14:22:16.038668 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.038010    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:16.038668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.038597    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 14:22:16.038668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.038639    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 14:22:16.038668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.038650    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 14:22:16.038951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.038803    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 14:22:16.038951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.038813    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 14:22:16.039060 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039045    2560 factory.go:55] Registering systemd factory
Jul 24 14:22:16.039113 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039079    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 24 14:22:16.039280 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039265    2560 factory.go:153] Registering CRI-O factory
Jul 24 14:22:16.039280 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039279    2560 factory.go:223] Registration of the crio container factory successfully
Jul 24 14:22:16.039426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039342    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 14:22:16.039426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039367    2560 factory.go:103] Registering Raw factory
Jul 24 14:22:16.039426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.039381    2560 manager.go:1196] Started watching for new ooms in manager
Jul 24 14:22:16.039718 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.038665    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc37430fb65  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.022809445 +0000 UTC m=+0.410829605,LastTimestamp:2026-07-24 14:22:16.022809445 +0000 UTC m=+0.410829605,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.040046 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.040032    2560 manager.go:349] Starting recovery of all containers
Jul 24 14:22:16.047621 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.047595    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:16.047837 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.047816    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 14:22:16.050023 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.049980    2560 manager.go:354] Recovery completed
Jul 24 14:22:16.054464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.054448    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.057035 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.056895    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.057120 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057053    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.057120 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057068    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.057786 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057768    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 14:22:16.057786 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057785    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 14:22:16.057921 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057806    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 14:22:16.057921 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.057777    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.059684 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059672    2560 policy_none.go:49] "None policy: Start"
Jul 24 14:22:16.059723 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059689    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 14:22:16.059723 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059700    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 14:22:16.059860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059843    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.059906 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059877    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.059906 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.059891    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.060784 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.060768    2560 policy_none.go:47] "Start"
Jul 24 14:22:16.067107 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.067017    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.077945 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.077864    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.092008 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.091928    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.101290 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101268    2560 manager.go:337] "Starting Device Plugin manager"
Jul 24 14:22:16.101424 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.101311    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 14:22:16.101424 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101322    2560 server.go:87] "Starting device plugin registration server"
Jul 24 14:22:16.101676 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101658    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 14:22:16.101795 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101677    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 14:22:16.101795 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101759    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 14:22:16.101989 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101850    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 14:22:16.101989 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.101859    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 14:22:16.102452 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.102364    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.059861255 +0000 UTC m=+0.447881362,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.102452 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.102435    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 14:22:16.102611 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.102486    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:16.115940 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.115857    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.059884071 +0000 UTC m=+0.447904179,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.117671 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.117651    2560 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2594 into the system container \"/system.slice\": <nil>"
Jul 24 14:22:16.132277 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.132168    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.059894448 +0000 UTC m=+0.447914556,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.142119 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.142032    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc379045769  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.103769961 +0000 UTC m=+0.491790055,LastTimestamp:2026-07-24 14:22:16.103769961 +0000 UTC m=+0.491790055,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.181548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.181505    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 14:22:16.182878 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.182860    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 14:22:16.182952 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.182900    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 14:22:16.182952 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.182926    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 14:22:16.183031 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.182966    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 14:22:16.194127 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.194046    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:16.202178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.202158    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.203137 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.203117    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.203245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.203154    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.203245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.203165    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.203245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.203189    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.213826 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.213737    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.20313911 +0000 UTC m=+0.591159220,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.220464 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.220434    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.220603 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.220511    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.203159094 +0000 UTC m=+0.591179202,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.225044 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.224974    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.203169074 +0000 UTC m=+0.591189182,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.259144 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.259106    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms"
Jul 24 14:22:16.283349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.283297    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"]
Jul 24 14:22:16.283488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.283429    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.284460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.284443    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.284547 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.284475    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.284547 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.284490    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.285801 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.285787    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.285909 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.285892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.285958 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.285919    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.286534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286517    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.286534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286529    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.286665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286545    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.286665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286574    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.286665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286575    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.286665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.286610    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.288155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.288137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.288155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.288162    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.288876 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.288859    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.288972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.288890    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.288972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.288906    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.297381 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.297304    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.28445956 +0000 UTC m=+0.672479670,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.307136 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.307051    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.28448078 +0000 UTC m=+0.672500888,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.315438 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.315410    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.316586 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.316496    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.284496049 +0000 UTC m=+0.672516156,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.320254 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.320238    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.325663 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.325585    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.286532124 +0000 UTC m=+0.674552231,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.335321 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.335245    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.286541769 +0000 UTC m=+0.674561877,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.340375 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.340350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.340493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.340382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.340493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.340397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6b45e66dca16cb6315837888a243eec-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"f6b45e66dca16cb6315837888a243eec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.344489 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.344415    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.286549391 +0000 UTC m=+0.674569497,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.358605 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.358494    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.286581041 +0000 UTC m=+0.674601147,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.367046 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.366968    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.286596568 +0000 UTC m=+0.674616678,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.376233 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.376135    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.286616522 +0000 UTC m=+0.674636630,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.385593 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.385498    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.288873418 +0000 UTC m=+0.676893530,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.394265 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.394179    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.288897096 +0000 UTC m=+0.676917204,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.403598 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.403495    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763bcbc6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057072582 +0000 UTC m=+0.445092689,LastTimestamp:2026-07-24 14:22:16.288912742 +0000 UTC m=+0.676932857,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.420620 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.420579    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.421648 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.421629    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.421768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.421658    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.421768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.421668    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.421768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.421705    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.431265 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.431152    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b3b3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057035581 +0000 UTC m=+0.445055688,LastTimestamp:2026-07-24 14:22:16.421644794 +0000 UTC m=+0.809664901,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.433371 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.433347    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.433444 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.433351    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c53fc3763b9ef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:16.057061112 +0000 UTC m=+0.445081218,LastTimestamp:2026-07-24 14:22:16.421662979 +0000 UTC m=+0.809683087,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:16.440606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.440606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.440749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6b45e66dca16cb6315837888a243eec-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"f6b45e66dca16cb6315837888a243eec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.440749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6b45e66dca16cb6315837888a243eec-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"f6b45e66dca16cb6315837888a243eec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.440749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.440749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.440695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/932e0f17d563105cb0f94984910b7617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"932e0f17d563105cb0f94984910b7617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.617670 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.617590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.624495 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.624468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.661466 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.661427    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms"
Jul 24 14:22:16.834044 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.834001    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:16.835130 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.835110    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:16.835237 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.835147    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:16.835237 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.835163    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:16.835237 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:16.835198    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:16.858875 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:16.858838    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:17.037022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.036999    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:17.133428 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:17.133395    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b45e66dca16cb6315837888a243eec.slice/crio-00071f4ea876f48a9ec91a88e1bcd481f4bd1de26fca936d341f04df5700b119 WatchSource:0}: Error finding container 00071f4ea876f48a9ec91a88e1bcd481f4bd1de26fca936d341f04df5700b119: Status 404 returned error can't find the container with id 00071f4ea876f48a9ec91a88e1bcd481f4bd1de26fca936d341f04df5700b119
Jul 24 14:22:17.133981 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:22:17.133954    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932e0f17d563105cb0f94984910b7617.slice/crio-8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 WatchSource:0}: Error finding container 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883: Status 404 returned error can't find the container with id 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883
Jul 24 14:22:17.138029 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.138011    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:22:17.147656 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.147574    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc3b6ad1e44  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\",Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.138241092 +0000 UTC m=+1.526261186,LastTimestamp:2026-07-24 14:22:17.138241092 +0000 UTC m=+1.526261186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:17.157360 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.157282    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-132-253.ec2.internal.18c53fc3b6ae0309  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-132-253.ec2.internal,UID:f6b45e66dca16cb6315837888a243eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\",Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:17.138299657 +0000 UTC m=+1.526319755,LastTimestamp:2026-07-24 14:22:17.138299657 +0000 UTC m=+1.526319755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:17.186855 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.186789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883"}
Jul 24 14:22:17.187883 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.187859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"f6b45e66dca16cb6315837888a243eec","Type":"ContainerStarted","Data":"00071f4ea876f48a9ec91a88e1bcd481f4bd1de26fca936d341f04df5700b119"}
Jul 24 14:22:17.226118 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.226088    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:17.227400 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.227383    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:17.227465 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.227415    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:17.227465 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.227425    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:17.373993 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.373905    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:17.374442 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.374417    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:17.463868 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.463835    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s"
Jul 24 14:22:17.505185 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.505146    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:17.596781 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.596740    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:17.659219 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.659136    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:17.660484 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.660457    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:17.660636 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.660495    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:17.660636 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.660511    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:17.660636 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:17.660550    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:17.684714 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:17.684672    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:18.040945 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:18.040859    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:19.041226 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.041181    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:19.077367 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.077327    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s"
Jul 24 14:22:19.115272 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.115180    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc42bd3cd92  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" in 1.965s (1.965s including waiting). Image size: 278280461 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.10371061 +0000 UTC m=+3.491730707,LastTimestamp:2026-07-24 14:22:19.10371061 +0000 UTC m=+3.491730707,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.137857 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.137738    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-132-253.ec2.internal.18c53fc42d103b11  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-132-253.ec2.internal,UID:f6b45e66dca16cb6315837888a243eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\" in 1.986s (1.986s including waiting). Image size: 317186379 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.124448017 +0000 UTC m=+3.512468112,LastTimestamp:2026-07-24 14:22:19.124448017 +0000 UTC m=+3.512468112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.205237 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.205126    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-132-253.ec2.internal.18c53fc430e0b7ee  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-132-253.ec2.internal,UID:f6b45e66dca16cb6315837888a243eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.188443118 +0000 UTC m=+3.576463238,LastTimestamp:2026-07-24 14:22:19.188443118 +0000 UTC m=+3.576463238,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.217880 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.217766    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-132-253.ec2.internal.18c53fc431710011  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-132-253.ec2.internal,UID:f6b45e66dca16cb6315837888a243eec,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.197898769 +0000 UTC m=+3.585918870,LastTimestamp:2026-07-24 14:22:19.197898769 +0000 UTC m=+3.585918870,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.228685 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.228641    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:19.265186 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.265145    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:19.266303 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.266269    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:19.266427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.266320    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:19.266427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.266335    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:19.285198 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.285168    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:19.286298 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.286270    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:19.286415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.286309    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:19.286415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.286322    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:19.286415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:19.286360    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:19.309348 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.309261    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:19.330720 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.330684    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:19.367047 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.366942    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,LastTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.376241 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.376150    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,LastTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:19.620689 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:19.620362    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:20.039592 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.039501    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:20.198271 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.198233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"f6b45e66dca16cb6315837888a243eec","Type":"ContainerStarted","Data":"dc55c80b35142e5156fd8973eff588f8cfd08803a65452a521d24ea297919dbe"}
Jul 24 14:22:20.198271 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.198256    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:20.199224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.199202    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:20.199355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.199236    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:20.199355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.199252    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:20.199457 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:20.199443    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:20.199774 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.199752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"}
Jul 24 14:22:20.201828 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.200109    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:20.202719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.202700    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:20.202817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.202731    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:20.202817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:20.202742    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:20.202925 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:20.202912    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:20.624857 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:20.624819    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:21.038059 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.037973    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:21.201434 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.201402    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:21.201951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.201405    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:21.202325 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202306    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:21.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202338    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:21.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202352    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:21.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202349    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:21.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202378    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:21.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:21.202390    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:21.202746 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:21.202727    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:21.202911 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:21.202892    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:22.038765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.038731    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:22.294388 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:22.294294    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s"
Jul 24 14:22:22.512059 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.512010    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:22.513324 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.513305    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:22.513425 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.513341    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:22.513425 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.513355    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:22.513425 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:22.513383    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:22.539745 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:22.539711    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:23.040131 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:23.040096    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:23.359044 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:23.358949    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:23.549267 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:23.549224    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:23.911485 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:23.911448    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:23.957273 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:23.957229    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:23.958385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:23.958365    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:23.958470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:23.958400    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:23.958470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:23.958412    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:24.039011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:24.038974    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:24.366985 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:24.366895    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:25.040785 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:25.040695    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:26.040317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:26.040285    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:26.105736 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:26.105690    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:27.037139 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:27.037106    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:28.038710 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.038670    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:28.711570 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:28.711520    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:28.940026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.939979    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:28.941385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.941365    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:28.941475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.941405    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:28.941475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.941415    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:28.941475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:28.941444    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:28.960441 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:28.960402    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:29.040381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:29.040291    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:30.036631 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:30.036594    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:31.036813 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.036778    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:31.225672 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.225639    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/0.log"
Jul 24 14:22:31.225856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.225682    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87" exitCode=1
Jul 24 14:22:31.225856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.225716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"}
Jul 24 14:22:31.225961 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.225875    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:31.227410 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.227389    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:31.227585 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.227421    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:31.227585 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:31.227434    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:31.227694 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:31.227652    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:31.242632 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:31.242522    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:31.230849792 +0000 UTC m=+15.618869900,LastTimestamp:2026-07-24 14:22:31.230849792 +0000 UTC m=+15.618869900,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:31.316193 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:31.316092    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,LastTimestamp:2026-07-24 14:22:31.304511518 +0000 UTC m=+15.692531613,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:31.325363 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:31.325274    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,LastTimestamp:2026-07-24 14:22:31.312801803 +0000 UTC m=+15.700821916,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:32.037752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.037723    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:32.228975 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.228948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/0.log"
Jul 24 14:22:32.229155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.229001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e"}
Jul 24 14:22:32.229155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.229140    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:32.229999 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.229973    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:32.230119 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.230005    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:32.230119 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.230015    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:32.230214 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:32.230204    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:32.442072 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.441972    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:32.442998 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.442972    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:32.443104 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.443027    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:32.443104 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:32.443043    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:32.587243 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:32.587213    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:32.982983 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:32.982946    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:33.038974 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:33.038945    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:34.019965 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:34.019923    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:34.039527 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:34.039496    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:34.124026 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:34.123991    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:35.037680 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.037646    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:35.722498 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:35.722465    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:35.961360 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.961321    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:35.967108 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.967083    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:35.967218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.967118    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:35.967218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.967128    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:35.967218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:35.967158    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:35.989403 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:35.989335    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:36.042242 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:36.042210    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:36.106763 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:36.106735    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:37.037307 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:37.037271    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:38.039665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:38.039633    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:39.037820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:39.037778    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:40.036855 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:40.036827    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:41.044539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:41.044511    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:42.041747 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.041715    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:42.739174 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:42.739081    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:42.990480 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.990406    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:42.991443 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.991423    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:42.991549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.991460    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:42.991549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.991474    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:42.991549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:42.991510    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:43.016304 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:43.016271    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:43.039630 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.039598    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:43.246526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.246448    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/1.log"
Jul 24 14:22:43.246882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.246865    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/0.log"
Jul 24 14:22:43.246940 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.246902    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e" exitCode=1
Jul 24 14:22:43.246940 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.246932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e"}
Jul 24 14:22:43.247026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.247016    2560 scope.go:117] "RemoveContainer" containerID="a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"
Jul 24 14:22:43.247090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.247079    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:43.247933 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.247912    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:43.248027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.247949    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:43.248027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.247963    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:43.248365 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:43.248201    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:43.248365 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.248276    2560 scope.go:117] "RemoveContainer" containerID="a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"
Jul 24 14:22:43.257850 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:43.257826    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:22:43.257926 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:43.257852    2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_0 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87'" containerID="a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"
Jul 24 14:22:43.257972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:43.257905    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87"} err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_0 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'a06e2e0005200b13797667d2fc4ae1a38f35e863491486a6eb3a0b3dd3f46e87'"
Jul 24 14:22:43.267177 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:43.267098    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:44.038667 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:44.038632    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:44.250385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:44.250357    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/1.log"
Jul 24 14:22:45.037809 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:45.037726    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:46.014725 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:46.014691    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:22:46.043731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:46.043696    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:46.107221 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:46.107190    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:47.043705 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:47.043668    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:48.037957 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:48.037921    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:49.039874 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:49.039841    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:49.754535 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:49.754483    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:50.017096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.017009    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:50.018133 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.018111    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:50.018233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.018151    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:50.018233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.018167    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:50.018233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.018207    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:50.031741 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:50.031704    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:50.042258 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:50.042233    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:50.976890 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:50.976847    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:22:51.037802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:51.037768    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:51.242888 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:51.242776    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:51.243921 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:51.243901    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:51.244043 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:51.243936    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:51.244043 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:51.243950    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:52.037535 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:52.037503    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:53.038490 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:53.038459    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:53.685722 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:53.685685    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:22:54.038706 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:54.038624    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:55.040383 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:55.040354    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:55.419884 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:55.419847    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:22:56.065266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.065230    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:56.107570 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.107518    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:22:56.183158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.183123    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:56.184118 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.184103    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:56.184216 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.184133    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:56.184216 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.184142    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:56.184362 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.184348    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:56.197186 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.197091    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:31.230849792 +0000 UTC m=+15.618869900,LastTimestamp:2026-07-24 14:22:56.185089049 +0000 UTC m=+40.573109144,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:56.266206 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.266115    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,LastTimestamp:2026-07-24 14:22:56.255444696 +0000 UTC m=+40.643464805,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:56.269332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.269309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/1.log"
Jul 24 14:22:56.269466 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.269361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23"}
Jul 24 14:22:56.269534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.269498    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:56.270223 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.270207    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:56.270300 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.270237    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:56.270300 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:56.270248    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:56.270439 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.270426    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:56.278151 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.278065    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,LastTimestamp:2026-07-24 14:22:56.263570762 +0000 UTC m=+40.651590869,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:22:56.765571 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:56.765515    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:22:57.039223 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.039138    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:57.043233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.043215    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:22:57.044155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.044137    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:22:57.044266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.044167    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:22:57.044266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.044177    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:22:57.044266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:57.044202    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:57.065083 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:22:57.065047    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:22:58.039175 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:58.039135    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:22:59.040895 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:22:59.040858    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:00.038245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:00.038210    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:01.038739 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:01.038704    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:02.038141 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:02.038107    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:03.039419 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:03.039384    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:03.778503 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:03.778460    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:04.041878 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.041800    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:04.065548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.065516    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:04.066534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.066502    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:04.066669 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.066539    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:04.066669 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.066552    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:04.066669 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:04.066605    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:04.086785 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:04.086751    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:05.036905 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:05.036875    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:06.038256 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:06.038225    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:06.107904 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:06.107855    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:07.043978 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:07.043944    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:08.040821 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.040787    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:08.289870 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.289844    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/2.log"
Jul 24 14:23:08.290221 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.290207    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/1.log"
Jul 24 14:23:08.290266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.290239    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23" exitCode=1
Jul 24 14:23:08.290306 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.290263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23"}
Jul 24 14:23:08.290306 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.290301    2560 scope.go:117] "RemoveContainer" containerID="13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e"
Jul 24 14:23:08.290430 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.290414    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:08.291577 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.291167    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:08.291577 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.291200    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:08.291577 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.291215    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:08.291577 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:08.291446    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:08.291577 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:08.291508    2560 scope.go:117] "RemoveContainer" containerID="13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e"
Jul 24 14:23:08.299580 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:08.299529    2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_1 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: '13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e'" containerID="13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e"
Jul 24 14:23:08.299674 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:08.299593    2560 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_1 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: '13407efd3a2db633ae7789faa40ff87fd08bdd82f51be36e2bcd1d08d06c0e9e'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" logger="UnhandledError"
Jul 24 14:23:08.299775 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:08.299756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:23:08.309347 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:08.309263    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:23:08.299699311 +0000 UTC m=+52.687719422,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:09.038738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:09.038705    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:09.293739 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:09.293659    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/2.log"
Jul 24 14:23:10.038507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:10.038469    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:10.790033 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:10.789987    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:11.041765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.041685    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:11.087247 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.087199    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:11.088819 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.088792    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:11.088819 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.088823    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:11.089004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.088835    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:11.089004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:11.088866    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:11.109253 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:11.109217    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:12.039786 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:12.039750    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:13.038172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:13.038134    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:14.038242 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:14.038206    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:15.038937 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:15.038903    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:16.040596 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:16.040544    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:16.108531 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:16.108471    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:17.040161 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:17.040125    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:17.802630 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:17.802593    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:18.037871 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.037842    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:18.110385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.110347    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:18.112222 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.112205    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:18.112334 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.112236    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:18.112334 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.112246    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:18.112334 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:18.112280    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:18.132087 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:18.132052    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:19.046006 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:19.045971    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:19.184022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:19.183992    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:19.185152 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:19.185134    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:19.185230 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:19.185176    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:19.185230 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:19.185188    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:19.185402 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:19.185388    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:19.185569 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:19.185541    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:23:19.195619 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:19.195503    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:23:19.185512357 +0000 UTC m=+63.573532463,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:19.613843 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:19.613807    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:23:20.036113 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:20.036033    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:21.038091 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:21.038059    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:22.042282 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:22.042251    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:22.828981 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:22.828945    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:23:23.037601 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:23.037573    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:24.048046 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:24.048008    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:24.255176 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:24.255142    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:23:24.812551 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:24.812516    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:25.039126 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.039097    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:25.132208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.132169    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:25.133321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.133295    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:25.133475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.133338    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:25.133475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.133355    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:25.133475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:25.133390    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:25.153103 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:25.153064    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:26.039992 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:26.039957    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:26.108695 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:26.108647    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:27.041073 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:27.041036    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:27.299310 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:27.299224    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:27.300280 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:27.300263    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:27.300379 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:27.300296    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:27.300379 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:27.300307    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:27.789203 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:27.789167    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:23:28.040740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:28.040669    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:29.040387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:29.040355    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:30.039540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:30.039507    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:31.039643 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:31.039612    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:31.822288 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:31.822249    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:32.043914 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.043879    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:32.153749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.153718    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:32.154821 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.154801    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:32.154943 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.154839    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:32.154943 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.154852    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:32.154943 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:32.154885    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:32.175469 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:32.175433    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:33.037151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:33.037114    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:34.039405 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.039376    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:34.184199 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.184156    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:34.189518 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.189500    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:34.189627 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.189534    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:34.189627 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.189544    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:34.189791 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:34.189778    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:34.203143 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:34.203051    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:31.230849792 +0000 UTC m=+15.618869900,LastTimestamp:2026-07-24 14:23:34.190517162 +0000 UTC m=+78.578537256,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:34.270721 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:34.270635    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,LastTimestamp:2026-07-24 14:23:34.2570338 +0000 UTC m=+78.645053906,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:34.287952 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:34.287860    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,LastTimestamp:2026-07-24 14:23:34.265194962 +0000 UTC m=+78.653215069,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:34.334888 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.334819    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/2.log"
Jul 24 14:23:34.334888 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.334864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf"}
Jul 24 14:23:34.335054 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.334987    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:34.335814 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.335800    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:34.335878 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.335834    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:34.335878 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:34.335848    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:34.336046 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:34.336034    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:35.036727 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:35.036699    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:36.041113 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:36.041074    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:36.109653 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:36.109603    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:36.183980 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:36.183943    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:36.185001 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:36.184982    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:36.185116 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:36.185015    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:36.185116 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:36.185030    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:36.185331 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:36.185315    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:37.039159 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:37.039047    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:38.038295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:38.038262    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:38.831675 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:38.831638    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:39.039036 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.039008    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:39.175865 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.175824    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:39.188390 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.188363    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:39.188464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.188400    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:39.188464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.188412    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:39.188464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:39.188440    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:39.215700 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:39.215667    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:40.044683 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:40.044648    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:41.037269 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:41.037232    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:42.037984 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:42.037941    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:43.038579 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:43.038531    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:44.037141 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:44.037098    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:45.036632 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.036598    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:45.353215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353187    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/3.log"
Jul 24 14:23:45.353596 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353582    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/2.log"
Jul 24 14:23:45.353655 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353614    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf" exitCode=1
Jul 24 14:23:45.353655 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf"}
Jul 24 14:23:45.353732 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353681    2560 scope.go:117] "RemoveContainer" containerID="c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23"
Jul 24 14:23:45.353767 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.353761    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:45.354630 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.354610    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:45.354738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.354648    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:45.354738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.354661    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:45.354886 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.354873    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:45.355218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:45.354934    2560 scope.go:117] "RemoveContainer" containerID="c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23"
Jul 24 14:23:45.363468 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.363424    2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_2 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23'" containerID="c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23"
Jul 24 14:23:45.363686 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.363491    2560 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_2 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'c7bc0defe1bb4d9e263c21da1ddc3291fd79412df5cb4734cf85202e7f927f23'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" logger="UnhandledError"
Jul 24 14:23:45.363837 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.363694    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:23:45.377397 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.377303    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:23:45.363647205 +0000 UTC m=+89.751667321,Count:4,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:45.840298 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:45.840260    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:46.038292 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.038262    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:46.110185 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:46.110157    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:46.216614 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.216506    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:46.217664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.217635    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:46.217793 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.217672    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:46.217793 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.217686    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:46.217793 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.217714    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:46.235838 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:46.235808    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:46.356763 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:46.356739    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/3.log"
Jul 24 14:23:47.039198 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:47.039168    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:48.038438 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:48.038404    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:49.038580 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:49.038536    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:50.037880 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:50.037848    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:51.040245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:51.040211    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:52.038466 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:52.038428    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:52.283000 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:52.282962    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:23:52.850265 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:52.850233    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:53.037258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.037223    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:53.236394 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.236300    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:53.237282 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.237251    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:53.237412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.237292    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:53.237412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.237304    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:53.237412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:53.237333    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:53.258357 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:53.258318    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:54.041730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:54.041692    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:55.036765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:55.036729    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:56.041014 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:56.040976    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:56.110537 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:56.110496    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:23:56.174323 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:56.174287    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:23:57.040266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:57.040229    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:58.041473 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:58.041447    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:59.036467 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:59.036431    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:23:59.183754 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:59.183719    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:23:59.184733 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:59.184714    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:23:59.184798 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:59.184754    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:23:59.184798 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:23:59.184769    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:23:59.184980 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:59.184967    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:23:59.185131 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:59.185116    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:23:59.200507 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:59.200416    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:23:59.185086451 +0000 UTC m=+103.573106564,Count:5,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:23:59.861356 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:59.861315    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:23:59.965449 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:23:59.965412    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:24:00.040830 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.040795    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:00.259269 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.259173    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:00.260280 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.260261    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:00.260395 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.260298    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:00.260395 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.260312    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:00.260395 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:00.260346    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:00.289855 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:00.289818    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:01.038513 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:01.038476    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:02.039645 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:02.039610    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:03.039062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:03.039033    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:04.040695 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:04.040663    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:05.045275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:05.045236    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:06.036750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:06.036714    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:06.111664 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:06.111617    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:06.872721 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:06.872668    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:07.037410 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.037382    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:07.290232 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.290139    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:07.293342 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.293320    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:07.293478 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.293356    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:07.293478 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.293366    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:07.293478 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:07.293395    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:07.314881 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:07.314844    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:08.040573 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:08.040524    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:09.042091 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:09.042057    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:10.038012 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:10.037981    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:11.039128 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:11.039094    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:12.042485 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:12.042454    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:13.038031 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:13.037988    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:13.183949 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:13.183918    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:13.185092 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:13.185069    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:13.185209 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:13.185102    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:13.185209 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:13.185114    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:13.185358 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:13.185345    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:13.185508 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:13.185490    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 40s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:24:13.196816 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:13.196730    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:24:13.185461146 +0000 UTC m=+117.573481241,Count:6,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:13.883603 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:13.883568    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:14.037177 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.037151    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:14.315784 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.315672    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:14.317417 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.317400    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:14.317492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.317432    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:14.317492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.317442    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:14.317492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:14.317469    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:14.340476 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:14.340445    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:15.036881 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:15.036847    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:16.041334 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:16.041301    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:16.041734 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:16.041411    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:24:16.112233 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:16.112189    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:17.042552 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:17.042517    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:18.043416 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:18.043384    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:19.038321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:19.038290    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:20.041261 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:20.041225    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:20.896471 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:20.896433    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:21.039375 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.039347    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:21.340926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.340883    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:21.342778 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.342756    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:21.342890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.342792    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:21.342890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.342802    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:21.342890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:21.342828    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:21.362394 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:21.362361    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:22.037972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:22.037943    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:23.038782 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:23.038742    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:24.038685 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:24.038650    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:25.039892 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:25.039857    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:26.039540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.039504    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:26.113099 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.113062    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:26.183755 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.183709    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:26.185022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.184998    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:26.185172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.185032    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:26.185172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.185042    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:26.185289 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.185269    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:26.196900 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.196817    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc6fea94300  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:31.230849792 +0000 UTC m=+15.618869900,LastTimestamp:2026-07-24 14:24:26.185986648 +0000 UTC m=+130.574006743,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:26.275986 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.275908    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43ac609f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.354466806 +0000 UTC m=+3.742486919,LastTimestamp:2026-07-24 14:24:26.265929522 +0000 UTC m=+130.653949640,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:26.288700 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.288590    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc43b5336f1  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:19.363718897 +0000 UTC m=+3.751739006,LastTimestamp:2026-07-24 14:24:26.273783855 +0000 UTC m=+130.661803965,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:26.419813 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.419788    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/3.log"
Jul 24 14:24:26.419953 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.419832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1"}
Jul 24 14:24:26.419953 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.419939    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:26.420858 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.420841    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:26.420934 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.420877    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:26.420934 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:26.420887    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:26.421088 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:26.421076    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:27.038208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:27.038179    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:27.908569 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:27.908513    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:28.038546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.038519    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:28.362653 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.362606    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:28.363655 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.363638    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:28.363724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.363670    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:28.363724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.363680    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:28.363724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:28.363723    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:28.384876 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:28.384848    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:29.038823 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:29.038790    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:30.038676 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:30.038644    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:31.040393 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:31.040362    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:32.046496 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:32.046466    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:33.039375 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:33.039344    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:34.040004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:34.039972    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:34.920186 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:34.920153    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:35.039466 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.039437    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:35.385575 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.385523    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:35.388365 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.388345    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:35.388446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.388383    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:35.388446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.388395    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:35.388446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:35.388422    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:35.413042 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:35.413014    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:36.048548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:36.048516    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:36.113876 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:36.113846    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:37.038712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.038675    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:37.183450 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.183417    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:37.184470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.184450    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:37.184546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.184484    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:37.184546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.184494    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:37.184720 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.184708    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:37.437521 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.437492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/4.log"
Jul 24 14:24:37.437910 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.437895    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/3.log"
Jul 24 14:24:37.437991 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.437928    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1" exitCode=1
Jul 24 14:24:37.437991 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.437955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1"}
Jul 24 14:24:37.438092 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.438000    2560 scope.go:117] "RemoveContainer" containerID="efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf"
Jul 24 14:24:37.438138 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.438104    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:37.439336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.439086    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:37.439336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.439127    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:37.439336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.439141    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:37.439456 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.439373    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:37.439456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:37.439440    2560 scope.go:117] "RemoveContainer" containerID="efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf"
Jul 24 14:24:37.447742 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.447696    2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_3 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf'" containerID="efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf"
Jul 24 14:24:37.447834 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.447758    2560 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_3 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'efe9ca9e0e9f48601cfb475b4a469b9fe729b3894b361d95d7c52278100be8cf'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" logger="UnhandledError"
Jul 24 14:24:37.447927 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.447909    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:24:37.458629 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.458518    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:24:37.447873994 +0000 UTC m=+141.835894104,Count:7,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:37.671863 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:37.671828    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 14:24:38.040104 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:38.040023    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:38.440694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:38.440663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/4.log"
Jul 24 14:24:39.040047 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:39.040013    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:39.444175 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:39.444150    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:39.445157 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:39.445134    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:39.445275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:39.445173    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:39.445275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:39.445187    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:40.040264 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:40.040232    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:41.051295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:41.051258    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:41.502354 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:41.502317    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 24 14:24:41.937750 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:41.937715    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:42.041872 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.041845    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:42.413428 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.413379    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:42.414369 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.414343    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:42.414477 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.414377    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:42.414477 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.414391    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:42.414477 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:42.414424    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:42.444591 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:42.444549    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:43.060879 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:43.060849    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:44.062508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:44.062467    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:45.042907 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:45.042866    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:46.039722 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:46.039679    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:46.114349 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:46.114306    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:47.039005 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:47.038970    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:47.324071 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:47.323983    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 14:24:48.040314 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:48.040281    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:48.952580 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:48.952525    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:49.043364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.043330    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:49.445141 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.445107    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:49.446134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.446114    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:49.446217 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.446149    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:49.446217 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.446159    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:49.446217 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:49.446190    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:49.465513 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:49.465473    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:50.037136 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:50.037100    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:51.038641 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:51.038602    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:51.183718 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:51.183677    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:51.184654 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:51.184635    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:51.184777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:51.184667    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:51.184777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:51.184677    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:51.184883 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:51.184872    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:51.185029 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:51.185011    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:24:51.194956 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:51.194873    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal.18c53fc9cb85a8cd  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal,UID:932e0f17d563105cb0f94984910b7617,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:BackOff,Message:Back-off restarting failed container setup in pod kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617),Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-24 14:22:43.257780429 +0000 UTC m=+27.645800539,LastTimestamp:2026-07-24 14:24:51.18498293 +0000 UTC m=+155.573003024,Count:8,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}"
Jul 24 14:24:52.038185 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:52.038154    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:52.733748 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:52.733714    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 14:24:53.037123 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:53.037053    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:54.038189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:54.038154    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:55.038169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:55.038133    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:55.969886 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:55.969843    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 24 14:24:56.041643 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.041616    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:56.114954 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:56.114920    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:24:56.466613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.466535    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:24:56.467488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.467466    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:24:56.467624 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.467501    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:24:56.467624 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.467514    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:24:56.467624 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:56.467548    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:56.487642 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:56.487616    2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:24:57.039625 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:57.039590    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:58.042912 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:58.042876    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 14:24:58.825597 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:58.825551    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hfdt"
Jul 24 14:24:58.962722 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:58.962674    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 14:24:59.153074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.153039    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.180756 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.180722    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.250279 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.250245    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.530121 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.530033    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.530121 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:59.530060    2560 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.581633 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.581598    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.604907 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.604873    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.672160 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.672127    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.829746 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.829648    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:19:58 +0000 UTC" deadline="2027-12-31 03:00:28.172955976 +0000 UTC"
Jul 24 14:24:59.829746 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.829696    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12588h35m28.343263676s"
Jul 24 14:24:59.944613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:24:59.944574    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:24:59.944613 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:24:59.944604    2560 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:00.228165 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:00.228129    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:00.257344 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:00.257313    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:00.325342 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:00.325310    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:00.606694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:00.606672    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:00.606694 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:00.606697    2560 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:02.622935 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:02.622902    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:02.663427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:02.663399    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:02.729886 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:02.729863    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:03.007286 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:03.007212    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:03.012530 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.012509    2560 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:03.012530 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:03.012535    2560 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-132-253.ec2.internal" not found
Jul 24 14:25:03.487933 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.487907    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:03.492649 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.492627    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:03.492737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.492661    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:03.492737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.492671    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:03.492737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.492698    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:03.505591 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:03.505568    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:03.505660 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:03.505600    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:03.524436 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:03.524411    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:03.624872 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:03.624830    2560 kubelet_node_status.go:448] "Node not becoming ready in time after startup"
Jul 24 14:25:06.115477 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:06.115425    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:06.134922 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:06.134887    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:06.183381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:06.183351    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:06.184278 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:06.184260    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:06.184372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:06.184290    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:06.184372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:06.184300    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:06.184532 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:06.184520    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:06.184701 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:06.184682    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:25:11.135984 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:11.135904    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:13.694331 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:13.694282    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:16.116007 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:16.115954    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:16.137012 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:16.136974    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:18.183717 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:18.183666    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:18.184701 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:18.184675    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:18.184815 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:18.184713    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:18.184815 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:18.184724    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:18.184952 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:18.184940    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:18.185096 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:18.185081    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:25:18.453105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:18.453026    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:21.137794 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:21.137756    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:22.371123 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:22.371089    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:23.987865 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:23.987815    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:24.110879 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:24.110839    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:26.116325 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:26.116269    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:26.138894 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:26.138860    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:31.140425 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:31.140387    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:31.183880 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:31.183845    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 14:25:31.188684 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:31.188665    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 14:25:31.188811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:31.188703    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 14:25:31.188811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:31.188717    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID"
Jul 24 14:25:31.189001 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:31.188986    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal"
Jul 24 14:25:31.189171 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:31.189152    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:25:34.132010 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:34.131957    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found"
Jul 24 14:25:35.616344 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:35.616309    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 14:25:35.638768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:35.638735    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal"
Jul 24 14:25:35.660209 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:35.660188    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:25:35.661178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:35.661163    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"
Jul 24 14:25:35.679480 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:35.679449    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 14:25:36.122664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.122638    2560 apiserver.go:52] "Watching apiserver"
Jul 24 14:25:36.134648 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.134608    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 14:25:36.135323 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.135296    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal","openshift-dns/node-resolver-bgg62","openshift-multus/multus-additional-cni-plugins-p7nwg","openshift-multus/multus-dxcfc","openshift-multus/network-metrics-daemon-jb6g4","openshift-network-diagnostics/network-check-target-7rjwp","openshift-network-operator/iptables-alerter-qrtdv","kube-system/global-pull-secret-syncer-6gv2s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf","openshift-cluster-node-tuning-operator/tuned-j4qkq","openshift-image-registry/node-ca-kd2fr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-5z77m","kube-system/konnectivity-agent-429hb"]
Jul 24 14:25:36.137834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.137811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.140074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.140055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.140922 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.140895    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:36.141441 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.141423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.141671 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.141658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2q5gx\""
Jul 24 14:25:36.142299 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.142282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.143213 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.143194    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 14:25:36.144544 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.144528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.144873 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.144850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 14:25:36.144977 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.144896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.144977 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.144906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.145668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.145650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-747zc\""
Jul 24 14:25:36.145956 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.145940    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 14:25:36.146028 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.146006    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 14:25:36.146890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.146866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.146965 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.146922    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:36.147037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.147021    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 14:25:36.147037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.147030    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.147526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.147512    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 14:25:36.149490 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.149462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:36.149597 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.149542    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:36.151783 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.151764    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.151955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.151930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-netns\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.151967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-etc-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.151990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-node-log\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-bin\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-config\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-env-overrides\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-ovn\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovn-node-metrics-cert\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmhr\" (UniqueName: \"kubernetes.io/projected/1ef21e42-62c8-4bc9-a603-f3027919f1ff-kube-api-access-xxmhr\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eef364f-5801-4131-aa2d-cff6824218f9-iptables-alerter-script\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152183    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvqr\" (UniqueName: \"kubernetes.io/projected/9eef364f-5801-4131-aa2d-cff6824218f9-kube-api-access-btvqr\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-systemd-units\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-systemd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-var-lib-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-netd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-script-lib\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eef364f-5801-4131-aa2d-cff6824218f9-host-slash\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-kubelet\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-slash\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-log-socket\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.152735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.152516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.154076 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.154061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.156534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.156518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.159007 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.158988    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.159155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.159140    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 14:25:36.161394 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.161371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.163938 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.163919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.164131 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.164112    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:36.164409 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.164392    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:25:36.168632 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.168614    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 14:25:36.168735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.168651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.168735 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.168698    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 14:25:36.168829 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.168754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.168829 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.168808    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 14:25:36.169740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.169721    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 14:25:36.169849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.169761    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.169849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.169763    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.169849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.169821    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.169972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.169825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 14:25:36.171648 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171630    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bnq4\""
Jul 24 14:25:36.171766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171656    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.171766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.171921 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 14:25:36.171985 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171939    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kwpgn\""
Jul 24 14:25:36.171985 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.171912    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jpbs5\""
Jul 24 14:25:36.172090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.172017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dbl6n\""
Jul 24 14:25:36.172090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.172028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 14:25:36.172090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.172029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9295s\""
Jul 24 14:25:36.172090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.172066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.176049 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.176034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4w69v\""
Jul 24 14:25:36.181950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.181930    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:25:36.181950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.181938    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 14:25:36.194742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.194722    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lrqwn\""
Jul 24 14:25:36.198862 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.198845    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 14:25:36.222795 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.222768    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5ds2"
Jul 24 14:25:36.233116 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.233093    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5ds2"
Jul 24 14:25:36.240328 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.240306    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 14:25:36.252859 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-kubelet\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.252929 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-run\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.252929 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-dbus\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.252929 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.253018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-systemd-units\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-var-lib-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.252997    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-systemd-units\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253106 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-var-lib-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253106 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-script-lib\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253106 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-k8s-cni-cncf-io\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.253189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-etc-kubernetes\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.253189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-conf\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.253189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.253189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.253333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-kubelet\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-lib-modules\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.253333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-tmp\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.253333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-registration-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.253333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-625fh\" (UniqueName: \"kubernetes.io/projected/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kube-api-access-625fh\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx8wx\" (UniqueName: \"kubernetes.io/projected/af0f1cba-33e8-4546-b0b8-69f8035511fc-kube-api-access-fx8wx\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-hostroot\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-kubelet\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-multus-certs\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysconfig\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13898532-553c-450b-93c3-1c8a298e9c56-konnectivity-ca\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovn-node-metrics-cert\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.253516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-os-release\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-bin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eef364f-5801-4131-aa2d-cff6824218f9-iptables-alerter-script\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvqr\" (UniqueName: \"kubernetes.io/projected/9eef364f-5801-4131-aa2d-cff6824218f9-kube-api-access-btvqr\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-script-lib\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-systemd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-systemd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af0f1cba-33e8-4546-b0b8-69f8035511fc-host\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-host\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-socket-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e14bb84c-ca41-4f10-b17c-12303ccb29ff-tmp-dir\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eef364f-5801-4131-aa2d-cff6824218f9-host-slash\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-log-socket\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-log-socket\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eef364f-5801-4131-aa2d-cff6824218f9-host-slash\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-kubernetes\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-kubelet-config\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-config\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.253991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-system-cni-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-multus\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-daemon-config\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-device-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmhr\" (UniqueName: \"kubernetes.io/projected/1ef21e42-62c8-4bc9-a603-f3027919f1ff-kube-api-access-xxmhr\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eef364f-5801-4131-aa2d-cff6824218f9-iptables-alerter-script\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-socket-dir-parent\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-sys-fs\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13898532-553c-450b-93c3-1c8a298e9c56-agent-certs\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-sys\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.254768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-systemd\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-netns\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-env-overrides\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-netns\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254340    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4s46\" (UniqueName: \"kubernetes.io/projected/667216b1-8c2e-4f95-9096-baadabf6e858-kube-api-access-w4s46\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-cni-binary-copy\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-conf-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-var-lib-kubelet\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-ovn\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af0f1cba-33e8-4546-b0b8-69f8035511fc-serviceca\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-os-release\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-system-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-run-ovn\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-cnibin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.255297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-tuned\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-netd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e14bb84c-ca41-4f10-b17c-12303ccb29ff-hosts-file\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7nv\" (UniqueName: \"kubernetes.io/projected/e14bb84c-ca41-4f10-b17c-12303ccb29ff-kube-api-access-8l7nv\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-env-overrides\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-netd\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-slash\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-cnibin\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-slash\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wnk\" (UniqueName: \"kubernetes.io/projected/0c0fa77c-bd67-4b22-9471-294aee2b495a-kube-api-access-n9wnk\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-etc-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-node-log\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-bin\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.255796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-netns\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-modprobe-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bgwh\" (UniqueName: \"kubernetes.io/projected/bcd13c7e-0917-4640-9b09-551f3d1e9006-kube-api-access-8bgwh\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-node-log\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.254986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8pnr\" (UniqueName: \"kubernetes.io/projected/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-kube-api-access-m8pnr\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.255002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-host-cni-bin\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.255021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ef21e42-62c8-4bc9-a603-f3027919f1ff-etc-openvswitch\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.256265 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.255286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovnkube-config\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.258586 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.258544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ef21e42-62c8-4bc9-a603-f3027919f1ff-ovn-node-metrics-cert\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.271276 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.271246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvqr\" (UniqueName: \"kubernetes.io/projected/9eef364f-5801-4131-aa2d-cff6824218f9-kube-api-access-btvqr\") pod \"iptables-alerter-qrtdv\" (UID: \"9eef364f-5801-4131-aa2d-cff6824218f9\") " pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.271389 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.271299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmhr\" (UniqueName: \"kubernetes.io/projected/1ef21e42-62c8-4bc9-a603-f3027919f1ff-kube-api-access-xxmhr\") pod \"ovnkube-node-5z77m\" (UID: \"1ef21e42-62c8-4bc9-a603-f3027919f1ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.355980 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.355947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-sys-fs\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.355980 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.355984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13898532-553c-450b-93c3-1c8a298e9c56-agent-certs\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-sys\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-sys-fs\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-sys\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-systemd\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-systemd\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4s46\" (UniqueName: \"kubernetes.io/projected/667216b1-8c2e-4f95-9096-baadabf6e858-kube-api-access-w4s46\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-cni-binary-copy\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-conf-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-var-lib-kubelet\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af0f1cba-33e8-4546-b0b8-69f8035511fc-serviceca\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-os-release\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-system-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-cnibin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-var-lib-kubelet\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-tuned\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e14bb84c-ca41-4f10-b17c-12303ccb29ff-hosts-file\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-os-release\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7nv\" (UniqueName: \"kubernetes.io/projected/e14bb84c-ca41-4f10-b17c-12303ccb29ff-kube-api-access-8l7nv\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-conf-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e14bb84c-ca41-4f10-b17c-12303ccb29ff-hosts-file\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-cnibin\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-cnibin\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.356766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wnk\" (UniqueName: \"kubernetes.io/projected/0c0fa77c-bd67-4b22-9471-294aee2b495a-kube-api-access-n9wnk\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-netns\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-modprobe-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bgwh\" (UniqueName: \"kubernetes.io/projected/bcd13c7e-0917-4640-9b09-551f3d1e9006-kube-api-access-8bgwh\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8pnr\" (UniqueName: \"kubernetes.io/projected/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-kube-api-access-m8pnr\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-system-cni-dir\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-kubelet\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-run\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-dbus\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-k8s-cni-cncf-io\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-etc-kubernetes\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-conf\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-cnibin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.356965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-cni-binary-copy\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.357750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-lib-modules\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-tmp\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-registration-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-lib-modules\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-625fh\" (UniqueName: \"kubernetes.io/projected/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kube-api-access-625fh\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx8wx\" (UniqueName: \"kubernetes.io/projected/af0f1cba-33e8-4546-b0b8-69f8035511fc-kube-api-access-fx8wx\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-hostroot\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.357209    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-multus-certs\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af0f1cba-33e8-4546-b0b8-69f8035511fc-serviceca\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.357296    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:36.857255425 +0000 UTC m=+201.245275541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-run\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-netns\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.358546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-kubelet\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357405    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-dbus\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-hostroot\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-k8s-cni-cncf-io\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-run-multus-certs\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-modprobe-d\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-etc-kubernetes\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysconfig\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.357636    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13898532-553c-450b-93c3-1c8a298e9c56-konnectivity-ca\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.357700    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:36.857683436 +0000 UTC m=+201.245703533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysconfig\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-os-release\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-bin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-os-release\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-sysctl-conf\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-bin\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-registration-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af0f1cba-33e8-4546-b0b8-69f8035511fc-host\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-host\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af0f1cba-33e8-4546-b0b8-69f8035511fc-host\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.357984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-socket-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e14bb84c-ca41-4f10-b17c-12303ccb29ff-tmp-dir\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-kubernetes\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-kubelet-config\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-system-cni-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-multus\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-daemon-config\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-device-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13898532-553c-450b-93c3-1c8a298e9c56-konnectivity-ca\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.359843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-socket-dir-parent\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-socket-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-socket-dir-parent\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/667216b1-8c2e-4f95-9096-baadabf6e858-system-cni-dir\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-host\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c0fa77c-bd67-4b22-9471-294aee2b495a-host-var-lib-cni-multus\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f0275c3-34a2-49dd-86e1-1f90c3139a98-kubelet-config\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-kubernetes\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-device-dir\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e14bb84c-ca41-4f10-b17c-12303ccb29ff-tmp-dir\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.358826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c0fa77c-bd67-4b22-9471-294aee2b495a-multus-daemon-config\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.359096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-etc-tuned\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.359227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/667216b1-8c2e-4f95-9096-baadabf6e858-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.359340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13898532-553c-450b-93c3-1c8a298e9c56-agent-certs\") pod \"konnectivity-agent-429hb\" (UID: \"13898532-553c-450b-93c3-1c8a298e9c56\") " pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.360362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.359612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcd13c7e-0917-4640-9b09-551f3d1e9006-tmp\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.375905 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.375829    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wnk\" (UniqueName: \"kubernetes.io/projected/0c0fa77c-bd67-4b22-9471-294aee2b495a-kube-api-access-n9wnk\") pod \"multus-dxcfc\" (UID: \"0c0fa77c-bd67-4b22-9471-294aee2b495a\") " pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.375905 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.375851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7nv\" (UniqueName: \"kubernetes.io/projected/e14bb84c-ca41-4f10-b17c-12303ccb29ff-kube-api-access-8l7nv\") pod \"node-resolver-bgg62\" (UID: \"e14bb84c-ca41-4f10-b17c-12303ccb29ff\") " pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.376101 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.376058    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:36.376101 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.376081    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:36.376101 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.376094    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:36.376235 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.376178    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:36.876157974 +0000 UTC m=+201.264178087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:36.376356 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.376342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx8wx\" (UniqueName: \"kubernetes.io/projected/af0f1cba-33e8-4546-b0b8-69f8035511fc-kube-api-access-fx8wx\") pod \"node-ca-kd2fr\" (UID: \"af0f1cba-33e8-4546-b0b8-69f8035511fc\") " pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.376995 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.376979    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8pnr\" (UniqueName: \"kubernetes.io/projected/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-kube-api-access-m8pnr\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.377846 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.377824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bgwh\" (UniqueName: \"kubernetes.io/projected/bcd13c7e-0917-4640-9b09-551f3d1e9006-kube-api-access-8bgwh\") pod \"tuned-j4qkq\" (UID: \"bcd13c7e-0917-4640-9b09-551f3d1e9006\") " pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.377963 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.377870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-625fh\" (UniqueName: \"kubernetes.io/projected/1b5f6f41-839a-4c98-ab30-e35b92fd2a3f-kube-api-access-625fh\") pod \"aws-ebs-csi-driver-node-lwvsf\" (UID: \"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.378415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.378391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4s46\" (UniqueName: \"kubernetes.io/projected/667216b1-8c2e-4f95-9096-baadabf6e858-kube-api-access-w4s46\") pod \"multus-additional-cni-plugins-p7nwg\" (UID: \"667216b1-8c2e-4f95-9096-baadabf6e858\") " pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.448459 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.448427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrtdv"
Jul 24 14:25:36.453885 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.453863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:25:36.457244 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.457206    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" podStartSLOduration=1.457193886 podStartE2EDuration="1.457193886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:36.456738928 +0000 UTC m=+200.844759034" watchObservedRunningTime="2026-07-24 14:25:36.457193886 +0000 UTC m=+200.845213995"
Jul 24 14:25:36.460057 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.460034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7nwg"
Jul 24 14:25:36.460357 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.460335    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eef364f_5801_4131_aa2d_cff6824218f9.slice/crio-a95808072bafebbd8378491ff7128c5c886f626fc847373d0c8288cc01d8c2d7 WatchSource:0}: Error finding container a95808072bafebbd8378491ff7128c5c886f626fc847373d0c8288cc01d8c2d7: Status 404 returned error can't find the container with id a95808072bafebbd8378491ff7128c5c886f626fc847373d0c8288cc01d8c2d7
Jul 24 14:25:36.464165 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.464132    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef21e42_62c8_4bc9_a603_f3027919f1ff.slice/crio-5ae3c4fc9287139c7c425bce3f546c1a76944b1dd36206d7ab318ed9b2ac0ab9 WatchSource:0}: Error finding container 5ae3c4fc9287139c7c425bce3f546c1a76944b1dd36206d7ab318ed9b2ac0ab9: Status 404 returned error can't find the container with id 5ae3c4fc9287139c7c425bce3f546c1a76944b1dd36206d7ab318ed9b2ac0ab9
Jul 24 14:25:36.465778 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.465753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxcfc"
Jul 24 14:25:36.471057 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.471037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf"
Jul 24 14:25:36.472859 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.472836    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667216b1_8c2e_4f95_9096_baadabf6e858.slice/crio-335c92226582016168fe2fa56e5d79c99bdc8a0c1b45c968ad50077f575bc1e6 WatchSource:0}: Error finding container 335c92226582016168fe2fa56e5d79c99bdc8a0c1b45c968ad50077f575bc1e6: Status 404 returned error can't find the container with id 335c92226582016168fe2fa56e5d79c99bdc8a0c1b45c968ad50077f575bc1e6
Jul 24 14:25:36.475687 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.475658    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0fa77c_bd67_4b22_9471_294aee2b495a.slice/crio-330256923d047dd1e0818fd50cde1e38a621893207aab86c7c23dcafd7ab38ad WatchSource:0}: Error finding container 330256923d047dd1e0818fd50cde1e38a621893207aab86c7c23dcafd7ab38ad: Status 404 returned error can't find the container with id 330256923d047dd1e0818fd50cde1e38a621893207aab86c7c23dcafd7ab38ad
Jul 24 14:25:36.476803 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.476784    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:36.481588 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.481570    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bgg62"
Jul 24 14:25:36.481953 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.481925    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5f6f41_839a_4c98_ab30_e35b92fd2a3f.slice/crio-4d302b8de65ed352a879bce496ea82fbfc931f0201f806093ab84eee43d4a6c7 WatchSource:0}: Error finding container 4d302b8de65ed352a879bce496ea82fbfc931f0201f806093ab84eee43d4a6c7: Status 404 returned error can't find the container with id 4d302b8de65ed352a879bce496ea82fbfc931f0201f806093ab84eee43d4a6c7
Jul 24 14:25:36.488447 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.488422    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j4qkq"
Jul 24 14:25:36.488897 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.488874    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13898532_553c_450b_93c3_1c8a298e9c56.slice/crio-63eeab29634f1ddd600c42390a7f539ae9ee3ef9111d9f9ea1f0ac5052ec6e39 WatchSource:0}: Error finding container 63eeab29634f1ddd600c42390a7f539ae9ee3ef9111d9f9ea1f0ac5052ec6e39: Status 404 returned error can't find the container with id 63eeab29634f1ddd600c42390a7f539ae9ee3ef9111d9f9ea1f0ac5052ec6e39
Jul 24 14:25:36.493381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.493364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kd2fr"
Jul 24 14:25:36.494790 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.494764    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14bb84c_ca41_4f10_b17c_12303ccb29ff.slice/crio-af9e66285741ad22142c003c9bcf7ec548f16ac58d0b257532dedb16b46350b9 WatchSource:0}: Error finding container af9e66285741ad22142c003c9bcf7ec548f16ac58d0b257532dedb16b46350b9: Status 404 returned error can't find the container with id af9e66285741ad22142c003c9bcf7ec548f16ac58d0b257532dedb16b46350b9
Jul 24 14:25:36.498263 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.498241    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd13c7e_0917_4640_9b09_551f3d1e9006.slice/crio-7179a7c4fd63df36836318f40974c4bf8652557a18605c888199d4c2252c5f45 WatchSource:0}: Error finding container 7179a7c4fd63df36836318f40974c4bf8652557a18605c888199d4c2252c5f45: Status 404 returned error can't find the container with id 7179a7c4fd63df36836318f40974c4bf8652557a18605c888199d4c2252c5f45
Jul 24 14:25:36.503168 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:25:36.503143    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0f1cba_33e8_4546_b0b8_69f8035511fc.slice/crio-3c8d434f84d4a5cb9b2e40b3f98c7a51fc7d56c3ef7aff14aebd1df79b3275f3 WatchSource:0}: Error finding container 3c8d434f84d4a5cb9b2e40b3f98c7a51fc7d56c3ef7aff14aebd1df79b3275f3: Status 404 returned error can't find the container with id 3c8d434f84d4a5cb9b2e40b3f98c7a51fc7d56c3ef7aff14aebd1df79b3275f3
Jul 24 14:25:36.528542 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.528506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kd2fr" event={"ID":"af0f1cba-33e8-4546-b0b8-69f8035511fc","Type":"ContainerStarted","Data":"3c8d434f84d4a5cb9b2e40b3f98c7a51fc7d56c3ef7aff14aebd1df79b3275f3"}
Jul 24 14:25:36.529467 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.529444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxcfc" event={"ID":"0c0fa77c-bd67-4b22-9471-294aee2b495a","Type":"ContainerStarted","Data":"330256923d047dd1e0818fd50cde1e38a621893207aab86c7c23dcafd7ab38ad"}
Jul 24 14:25:36.530495 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.530477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerStarted","Data":"335c92226582016168fe2fa56e5d79c99bdc8a0c1b45c968ad50077f575bc1e6"}
Jul 24 14:25:36.531488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.531468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"5ae3c4fc9287139c7c425bce3f546c1a76944b1dd36206d7ab318ed9b2ac0ab9"}
Jul 24 14:25:36.532484 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.532463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrtdv" event={"ID":"9eef364f-5801-4131-aa2d-cff6824218f9","Type":"ContainerStarted","Data":"a95808072bafebbd8378491ff7128c5c886f626fc847373d0c8288cc01d8c2d7"}
Jul 24 14:25:36.533433 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.533415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4qkq" event={"ID":"bcd13c7e-0917-4640-9b09-551f3d1e9006","Type":"ContainerStarted","Data":"7179a7c4fd63df36836318f40974c4bf8652557a18605c888199d4c2252c5f45"}
Jul 24 14:25:36.534386 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.534365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgg62" event={"ID":"e14bb84c-ca41-4f10-b17c-12303ccb29ff","Type":"ContainerStarted","Data":"af9e66285741ad22142c003c9bcf7ec548f16ac58d0b257532dedb16b46350b9"}
Jul 24 14:25:36.535465 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.535438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-429hb" event={"ID":"13898532-553c-450b-93c3-1c8a298e9c56","Type":"ContainerStarted","Data":"63eeab29634f1ddd600c42390a7f539ae9ee3ef9111d9f9ea1f0ac5052ec6e39"}
Jul 24 14:25:36.536473 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.536455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf" event={"ID":"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f","Type":"ContainerStarted","Data":"4d302b8de65ed352a879bce496ea82fbfc931f0201f806093ab84eee43d4a6c7"}
Jul 24 14:25:36.861919 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.861875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:36.862632 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.861943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:36.862632 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.862017    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:36.862632 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.862052    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:36.862632 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.862106    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:37.862084107 +0000 UTC m=+202.250104201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:36.862632 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.862131    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:37.862118308 +0000 UTC m=+202.250138401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:36.962988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:36.962950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:36.963212 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.963121    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:36.963285 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.963216    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:36.963285 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.963230    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:36.963378 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:36.963294    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:37.96327392 +0000 UTC m=+202.351294038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:37.183935 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.183847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:37.184109 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.184003    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:37.236781 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.236633    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:20:36 +0000 UTC" deadline="2028-02-12 16:41:43.809737324 +0000 UTC"
Jul 24 14:25:37.236781 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.236676    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13634h16m6.573065672s"
Jul 24 14:25:37.870158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.870119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:37.870792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.870168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:37.870792 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.870314    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:37.870792 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.870376    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:39.87035736 +0000 UTC m=+204.258377454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:37.870792 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.870612    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:37.870792 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.870659    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:39.870644965 +0000 UTC m=+204.258665061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:37.971759 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:37.970990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:37.971759 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.971230    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:37.971759 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.971254    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:37.971759 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.971266    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:37.971759 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:37.971325    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:39.971306615 +0000 UTC m=+204.359326713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:38.183879 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:38.183614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:38.183879 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:38.183788    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:38.184495 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:38.184206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:38.184495 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:38.184333    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:38.236987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:38.236942    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:20:36 +0000 UTC" deadline="2028-04-07 00:52:07.268695114 +0000 UTC"
Jul 24 14:25:38.236987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:38.236985    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14938h26m29.031714136s"
Jul 24 14:25:39.183842 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:39.183808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:39.184345 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.183960    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:39.888673 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:39.888628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:39.888884 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:39.888684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:39.888884 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.888849    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:39.888995 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.888919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:43.888895959 +0000 UTC m=+208.276916076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:39.889286 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.889262    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:39.889375 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.889338    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:43.889316752 +0000 UTC m=+208.277336864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:39.989614 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:39.989575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:39.989919 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.989785    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:39.989919 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.989815    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:39.989919 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.989830    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:39.989919 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:39.989898    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:43.989878815 +0000 UTC m=+208.377898922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:40.184205 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:40.183663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:40.184205 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:40.183805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:40.184205 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:40.184170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:40.184811 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:40.184291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:41.142455 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:41.142409    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:41.183231 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:41.183192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:41.183421 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:41.183364    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:42.184551 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:42.184061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:42.184551 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:42.184076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:42.184551 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:42.184208    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:42.184551 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:42.184295    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:43.183749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:43.183690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:43.183956 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:43.183871    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:43.925476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:43.925532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:43.925695    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:43.925715    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:43.925784    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:51.925761503 +0000 UTC m=+216.313781598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:43.925806 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:43.925804    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:51.92579375 +0000 UTC m=+216.313813846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:44.026808 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:44.026763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:44.027514 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.026999    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:44.027514 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.027027    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:44.027514 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.027039    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:44.027514 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.027116    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:25:52.027094724 +0000 UTC m=+216.415114837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:44.185151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:44.185061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:44.185315 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.185201    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:44.185750 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:44.185644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:44.185903 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:44.185832    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:45.183913 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:45.183857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:45.184584 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:45.184014    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:46.143648 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:46.143607    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:46.184784 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:46.184745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:46.185270 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:46.184866    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:46.185270 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:46.184918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:46.185270 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:46.185022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:47.183566 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:47.183512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:47.183759 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:47.183691    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:48.184189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:48.184149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:48.184189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:48.184171    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:48.184758 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:48.184474    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:48.184758 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:48.184614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:48.184758 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:48.184677    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=setup pod=kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podUID="932e0f17d563105cb0f94984910b7617"
Jul 24 14:25:49.183693 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:49.183653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:49.183890 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:49.183813    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:50.183268 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:50.183220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:50.183268 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:50.183267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:50.183961 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:50.183353    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:50.183961 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:50.183473    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:51.145053 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.144978    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:51.183301 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:51.183259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:51.183774 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.183399    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:51.996771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:51.996724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:51.996771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:51.996778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:51.997012 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.996882    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:51.997012 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.996892    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:51.997012 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.996957    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:07.996936539 +0000 UTC m=+232.384956653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:25:51.997012 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:51.996972    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:07.99696519 +0000 UTC m=+232.384985284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:25:52.097955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:52.097909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:52.098178 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.098078    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:25:52.098178 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.098099    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:25:52.098178 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.098111    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:52.098327 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.098190    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:08.098170901 +0000 UTC m=+232.486191001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:25:52.183932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:52.183895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:52.184431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:52.183947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:52.184431 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.184019    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:52.184431 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:52.184144    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:53.184183 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:53.184141    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:53.184721 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:53.184271    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:54.183737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:54.183692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:54.183904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:54.183693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:54.183904 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:54.183814    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:54.183975 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:54.183912    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:55.183837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.183650    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:55.184359 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:55.183925    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:55.580530 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.580435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bgg62" event={"ID":"e14bb84c-ca41-4f10-b17c-12303ccb29ff","Type":"ContainerStarted","Data":"8ee8283dc45d894ceae8c178c8d341280ebc937038f614a555f2d349baa81e78"}
Jul 24 14:25:55.582358 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.582313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-429hb" event={"ID":"13898532-553c-450b-93c3-1c8a298e9c56","Type":"ContainerStarted","Data":"6f8ca0177f31ef5782703d4f3f46fa9557155e6ded4ac1e771f7496d51a824da"}
Jul 24 14:25:55.583939 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.583902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf" event={"ID":"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f","Type":"ContainerStarted","Data":"e878a0d3a2e97a664782daa60ef2b438181432a49c9fb701a623ef1d39df603b"}
Jul 24 14:25:55.585520 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.585481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kd2fr" event={"ID":"af0f1cba-33e8-4546-b0b8-69f8035511fc","Type":"ContainerStarted","Data":"fcb9774f1ad0376fac431d351d0fdeaed5392b919dd7dfc6d482f33427f56eee"}
Jul 24 14:25:55.587213 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.587186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxcfc" event={"ID":"0c0fa77c-bd67-4b22-9471-294aee2b495a","Type":"ContainerStarted","Data":"fffc98070d42cf7e37cdbaa49c55afeb954e79584c01d9c3caf5c79bd460c71c"}
Jul 24 14:25:55.588927 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.588900    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="4474ec84812fef2249b7d82a2a8a5f34a4fac6a2e3a49bc6fb701164c0cf33d8" exitCode=0
Jul 24 14:25:55.589022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.588980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"4474ec84812fef2249b7d82a2a8a5f34a4fac6a2e3a49bc6fb701164c0cf33d8"}
Jul 24 14:25:55.592597 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"8ffe2e312c5035ec4a77297d27d58187f6aa438110f423fc83503576384b0eb1"}
Jul 24 14:25:55.592710 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"2933a32ee70963fefd7eb694dc72de5039b53fb865ed326a807c5d7aa0cc2b82"}
Jul 24 14:25:55.592841 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"e28597523f1c4e70b0c7c37554e3a5e75876e4ee19674e6f3c593caa534d58d4"}
Jul 24 14:25:55.592900 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"1c2d4d7260f8c8e2798e4c2fbf74e909171398a5d3c0bab76708ccf3c7507f85"}
Jul 24 14:25:55.592945 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"82c3961e78bb60a597e7fe69bceead2950f920eaae10cd3b5a66fefe744bed82"}
Jul 24 14:25:55.592994 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.592954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"02e8cb6384d4d228034c5d5a00714e31fc87100d8d2f52eb4fa57df5d7250fe9"}
Jul 24 14:25:55.594303 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.594280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j4qkq" event={"ID":"bcd13c7e-0917-4640-9b09-551f3d1e9006","Type":"ContainerStarted","Data":"29f32b855f11ea52c82360047d3764c10472691bcc77ceb056c31793012c835e"}
Jul 24 14:25:55.606381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.606333    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bgg62" podStartSLOduration=34.334553827 podStartE2EDuration="52.606318757s" totalImagesPullingTime="18.27176493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.605860501 +0000 UTC m=+219.993880618" watchObservedRunningTime="2026-07-24 14:25:55.606318757 +0000 UTC m=+219.994338874"
Jul 24 14:25:55.702694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.702644    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxcfc" podStartSLOduration=34.345768966 podStartE2EDuration="52.702624907s" totalImagesPullingTime="18.356855941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.679710229 +0000 UTC m=+220.067730343" watchObservedRunningTime="2026-07-24 14:25:55.702624907 +0000 UTC m=+220.090645023"
Jul 24 14:25:55.748728 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.748671    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-429hb" podStartSLOduration=34.469686181 podStartE2EDuration="52.748651619s" totalImagesPullingTime="18.278965438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.702759371 +0000 UTC m=+220.090779488" watchObservedRunningTime="2026-07-24 14:25:55.748651619 +0000 UTC m=+220.136671739"
Jul 24 14:25:55.786358 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.786298    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j4qkq" podStartSLOduration=34.516689721 podStartE2EDuration="52.786281559s" totalImagesPullingTime="18.269591838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.75602853 +0000 UTC m=+220.144048663" watchObservedRunningTime="2026-07-24 14:25:55.786281559 +0000 UTC m=+220.174301674"
Jul 24 14:25:55.949841 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.949814    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 14:25:55.964269 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:55.964224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:56.091008 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.090957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:56.145596 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:56.145483    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:25:56.184275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.184202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:56.185022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.184303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:56.185022 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:56.184317    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:56.185022 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:56.184433    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:56.265403 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.265301    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:25:55.949831856Z","UUID":"ae02d1d1-90bb-418c-9c75-a3123ee16d7a","Handler":null,"Name":"","Endpoint":""}
Jul 24 14:25:56.266822 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.266803    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 14:25:56.266943 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.266842    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 14:25:56.477589 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.477215    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:56.477994 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.477971    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:56.501463 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.501401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kd2fr" podStartSLOduration=35.214617394 podStartE2EDuration="53.50137639s" totalImagesPullingTime="18.286758996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.786441437 +0000 UTC m=+220.174461553" watchObservedRunningTime="2026-07-24 14:25:56.50137639 +0000 UTC m=+220.889396504"
Jul 24 14:25:56.598845 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.598806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrtdv" event={"ID":"9eef364f-5801-4131-aa2d-cff6824218f9","Type":"ContainerStarted","Data":"64392dcad9f4a78acddf62d034b3494165a46631a7cb74c419d305b66f08c907"}
Jul 24 14:25:56.601387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.601351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf" event={"ID":"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f","Type":"ContainerStarted","Data":"bd9b63fc03a75181e0139214d5f88e9557855685f74c351f2f659ef3e329d621"}
Jul 24 14:25:56.602120 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.601823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:56.602454 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.602433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-429hb"
Jul 24 14:25:56.619850 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.619786    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrtdv" podStartSLOduration=35.266762299 podStartE2EDuration="53.619765511s" totalImagesPullingTime="18.353003212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:56.619489626 +0000 UTC m=+221.007509745" watchObservedRunningTime="2026-07-24 14:25:56.619765511 +0000 UTC m=+221.007785629"
Jul 24 14:25:56.750972 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.750886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:56.849172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.849122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:56.947430 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:56.947394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:57.184002 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:57.183964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:57.184200 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:57.184086    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:57.606765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:57.606727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"9c2488b0778a55d874cf80058a3eabe82151af8f33adbfaaa4bf67564a001bc7"}
Jul 24 14:25:57.609212 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:57.609157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf" event={"ID":"1b5f6f41-839a-4c98-ab30-e35b92fd2a3f","Type":"ContainerStarted","Data":"1fb423de46aaf71848bec589b16e3f79407e1f6a6205aa0b9697e5a3388773a6"}
Jul 24 14:25:57.633802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:57.633737    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lwvsf" podStartSLOduration=34.717973257 podStartE2EDuration="54.633714055s" totalImagesPullingTime="19.915740798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:57.6335212 +0000 UTC m=+222.021541318" watchObservedRunningTime="2026-07-24 14:25:57.633714055 +0000 UTC m=+222.021734173"
Jul 24 14:25:58.183868 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:58.183821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:25:58.184067 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:58.183841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:25:58.184067 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:58.183967    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:25:58.184067 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:58.184043    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:25:59.183413 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:59.183370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:25:59.184190 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:25:59.183496    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:25:59.773491 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:59.773317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:25:59.936309 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:25:59.936280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.183847 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.183816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:00.184221 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.183858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:00.184221 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:00.183934    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:00.184221 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:00.184046    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:00.285025 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.284985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.392204 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.392163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.509646 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.509601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.617376 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.617338    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="24b2f185c7c90675707cd33f92716d127089d9f60c18a95494b5474f37b0072a" exitCode=0
Jul 24 14:26:00.617594 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.617429    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"24b2f185c7c90675707cd33f92716d127089d9f60c18a95494b5474f37b0072a"}
Jul 24 14:26:00.621369 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.621344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" event={"ID":"1ef21e42-62c8-4bc9-a603-f3027919f1ff","Type":"ContainerStarted","Data":"383b000efdd348e0ae5d0fd4d9aecc20c46f8f9e7ee46485fcde0e38ef80073f"}
Jul 24 14:26:00.621597 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.621583    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:00.638527 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.638500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:00.640034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.640009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.740913 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.740820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:00.803464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:00.803434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bgg62_e14bb84c-ca41-4f10-b17c-12303ccb29ff/dns-node-resolver/0.log"
Jul 24 14:26:01.149375 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:01.149287    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:01.184001 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.183968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:01.184348 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:01.184085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:01.515540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.515465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:01.616078 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.616044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:01.623998 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.623965    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:01.624150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.624041    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:01.639549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.639521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:01.675958 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:01.675904    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m" podStartSLOduration=40.281536274 podStartE2EDuration="58.675889309s" totalImagesPullingTime="18.394353035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:00.694519104 +0000 UTC m=+225.082539222" watchObservedRunningTime="2026-07-24 14:26:01.675889309 +0000 UTC m=+226.063909466"
Jul 24 14:26:02.183893 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.183614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:02.184067 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.183827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:02.184067 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.183996    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:02.184067 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.184035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:02.203794 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.203761    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kd2fr_af0f1cba-33e8-4546-b0b8-69f8035511fc/node-ca/0.log"
Jul 24 14:26:02.224987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.224940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:02.322955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.322925    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:02.628078 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.628041    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="d1b6fecaee71ba45452186818a4a2851f75f195da3bc33994e3d8cb56f0e34e4" exitCode=0
Jul 24 14:26:02.628234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.628131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"d1b6fecaee71ba45452186818a4a2851f75f195da3bc33994e3d8cb56f0e34e4"}
Jul 24 14:26:02.630065 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.630047    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_932e0f17d563105cb0f94984910b7617/setup/4.log"
Jul 24 14:26:02.630132 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.630085    2560 generic.go:356] "Generic (PLEG): container finished" podID="932e0f17d563105cb0f94984910b7617" containerID="c516c7c6d42a30eef99af88881b93f7577a877235b450546838c59f484b5fad8" exitCode=0
Jul 24 14:26:02.630194 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.630161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerDied","Data":"c516c7c6d42a30eef99af88881b93f7577a877235b450546838c59f484b5fad8"}
Jul 24 14:26:02.630245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.630233    2560 scope.go:117] "RemoveContainer" containerID="fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1"
Jul 24 14:26:02.630818 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.630799    2560 scope.go:117] "RemoveContainer" containerID="fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1"
Jul 24 14:26:02.646239 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.646193    2560 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_4 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1'" containerID="fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1"
Jul 24 14:26:02.646333 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.646262    2560 kuberuntime_container.go:962] "Unhandled Error" err="failed to remove pod init container \"setup\": rpc error: code = Unknown desc = failed to delete container k8s_setup_kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator_932e0f17d563105cb0f94984910b7617_4 in pod sandbox 8d3348e452a24aa525d9a4d3a619bb22ae204ec340acb1f84d8c4287f67d3883 from index: no such id: 'fa62f029eceb24b4adacdbe2fc90e92b84336915174eee73cb0dd8027ac972c1'; Skipping pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal_openshift-machine-config-operator(932e0f17d563105cb0f94984910b7617)\"" logger="UnhandledError"
Jul 24 14:26:02.764762 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.764732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gv2s"]
Jul 24 14:26:02.764929 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.764903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:02.765042 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.765022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:02.765432 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.765412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jb6g4"]
Jul 24 14:26:02.765516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.765505    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:02.765619 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.765602    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:02.771856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.771828    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7rjwp"]
Jul 24 14:26:02.771987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:02.771940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:02.772058 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:02.772036    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:03.433049 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:03.433017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:03.634328 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:03.634293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"932e0f17d563105cb0f94984910b7617","Type":"ContainerStarted","Data":"1f59458b5021cc0ef4420d4d1d7791d08c3933b507d5fcc088be7bee7c0cad78"}
Jul 24 14:26:03.654031 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:03.653979    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podStartSLOduration=28.653963175 podStartE2EDuration="28.653963175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:03.653638052 +0000 UTC m=+228.041658293" watchObservedRunningTime="2026-07-24 14:26:03.653963175 +0000 UTC m=+228.041983291"
Jul 24 14:26:03.872827 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:03.872797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:04.101235 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.101209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:04.183373 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.183340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:04.183373 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.183363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:04.183546 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:04.183475    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:04.183621 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:04.183584    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:04.202306 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.202269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:04.337372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.337343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:04.456409 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.456324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:04.638495 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.638454    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="d1989d3cf01c0db91e09732e97e210b738e45295f200f4ad71786fcf1298e4dc" exitCode=0
Jul 24 14:26:04.638698 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.638525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"d1989d3cf01c0db91e09732e97e210b738e45295f200f4ad71786fcf1298e4dc"}
Jul 24 14:26:04.690699 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:04.690670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:05.183915 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:05.183883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:05.184134 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:05.184011    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:05.774327 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:05.774290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:05.996825 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:05.996787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:06.150065 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:06.150021    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:06.184848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:06.184637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:06.185039 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:06.184725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:06.185039 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:06.184925    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:06.185153 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:06.185047    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:06.196821 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:06.196790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:06.377767 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:06.377732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:06.590968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:06.590934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:07.183404 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:07.183369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:07.183835 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:07.183492    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:07.236905 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:07.236865    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:07.335860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:07.335776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:07.866842 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:07.866796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:07.970877 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:07.970845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:08.025024 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.024982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:08.025209 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.025030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:08.025209 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.025102    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:08.025209 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.025179    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:40.025157336 +0000 UTC m=+264.413177446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:08.025209 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.025194    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:08.025388 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.025258    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:40.025240881 +0000 UTC m=+264.413260979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:08.067613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.067577    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:08.126224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.126132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:08.126399 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.126289    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:26:08.126399 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.126320    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:26:08.126399 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.126334    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:08.126399 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.126398    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:40.126379238 +0000 UTC m=+264.514399334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:08.183811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.183764    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:08.183811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.183816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:08.184367 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.183904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:08.184367 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:08.183996    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:08.208171 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.208141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:08.398450 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.398351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:08.528661 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.528623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:08.690861 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:08.690784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:09.184279 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:09.184077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:09.184279 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:09.184190    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:09.653156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:09.653120    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="625d8da683abea933b67ba08404100ea511ad45ce2fdc3231b5cf343bcd068e8" exitCode=0
Jul 24 14:26:09.653338 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:09.653190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"625d8da683abea933b67ba08404100ea511ad45ce2fdc3231b5cf343bcd068e8"}
Jul 24 14:26:09.762012 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:09.761979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:09.986446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:09.986364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:10.183837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.183799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:10.184041 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.183799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:10.184041 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:10.183935    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:10.184041 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:10.183977    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:10.243476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.243390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:10.357888 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.357856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:10.476429 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.473995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:10.658925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.658892    2560 generic.go:356] "Generic (PLEG): container finished" podID="667216b1-8c2e-4f95-9096-baadabf6e858" containerID="4c230f7dbdf178d2842458cb0cd0d8ed9fcb63afb2278481633ac08c3025d401" exitCode=0
Jul 24 14:26:10.659124 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.658952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerDied","Data":"4c230f7dbdf178d2842458cb0cd0d8ed9fcb63afb2278481633ac08c3025d401"}
Jul 24 14:26:10.794343 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:10.794282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:11.151338 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:11.151298    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:11.183652 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:11.183624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:11.183836 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:11.183738    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:11.576946 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:11.576868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:11.664610 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:11.664577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" event={"ID":"667216b1-8c2e-4f95-9096-baadabf6e858","Type":"ContainerStarted","Data":"2dff16ca7094ac770554237bfdfd04b664b4d90a16fe26fd74ee66ac566e17cd"}
Jul 24 14:26:11.990436 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:11.990402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:12.168309 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.168272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:12.183293 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.183250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:12.183436 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:12.183386    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:12.183481 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.183439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:12.183546 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:12.183528    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:12.394742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.394707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:12.794547 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.794465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:12.891501 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:12.891467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:13.053548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:13.053460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:13.183838 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:13.183798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:13.184007 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:13.183908    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:13.390610 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:13.390575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:13.765729 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:13.765643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:13.980238 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:13.980207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:14.175835 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:14.175803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:14.186732 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:14.186707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:14.186870 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:14.186707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:14.186870 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:14.186809    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:14.186939 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:14.186882    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:14.581310 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:14.581227    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:15.184156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:15.184108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:15.184649 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:15.184243    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:15.653857 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:15.653820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:15.804225 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:15.804176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:16.151996 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:16.151958    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:16.184004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:16.183972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:16.184238 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:16.184066    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:16.184238 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:16.184123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:16.184574 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:16.184249    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:17.183530 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:17.183491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:17.183761 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:17.183624    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:18.183462 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:18.183423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:18.183950 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:18.183548    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:18.183950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:18.183585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:18.183950 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:18.183646    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:19.183574 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:19.183529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:19.183963 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:19.183658    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:20.183370 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:20.183332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:20.183528 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:20.183344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:20.183528 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:20.183446    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:20.183909 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:20.183581    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:21.153227 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:21.153180    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:21.184037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:21.184006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:21.184377 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:21.184124    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:22.153957 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.153922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:22.183981 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.183951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:22.184103 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.183952    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:22.184103 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:22.184056    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:22.184442 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:22.184184    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:22.249906 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.249874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:22.432926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.432838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:22.610637 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.610604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:22.703533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:22.703454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:23.183836 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:23.183804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:23.184040 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:23.183971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:23.225908 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:23.225878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:23.837744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:23.837706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:24.071496 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.071464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:24.183830 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.183796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:24.184004 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:24.183965    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:24.184073 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.184000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:24.184127 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:24.184110    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:24.197400 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.197368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:24.318242 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.318206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:24.500351 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:24.500279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:25.184069 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:25.184032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:25.184227 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:25.184146    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:26.093536 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:26.093498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:26.153930 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:26.153893    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:26.183987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:26.183950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:26.184160 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:26.184058    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:26.184160 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:26.184143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:26.184293 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:26.184271    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:26.800153 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:26.800116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:26.960320 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:26.960284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:27.066976 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:27.066898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:27.183407 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:27.183374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:27.183748 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:27.183481    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:27.488941 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:27.488907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:28.183683 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:28.183651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:28.184125 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:28.183771    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:28.184125 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:28.183812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:28.184125 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:28.183935    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:29.183716 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:29.183681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:29.184106 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:29.183801    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:30.183700 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:30.183660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:30.183700 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:30.183685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:30.184134 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:30.183790    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:30.184134 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:30.183942    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:31.154988 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:31.154949    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:31.183520 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:31.183474    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:31.183705 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:31.183636    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:32.183834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:32.183797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:32.184305 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:32.183798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:32.184305 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:32.183913    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:32.184305 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:32.184021    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:33.183517 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:33.183480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:33.183737 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:33.183608    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:33.653191 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:33.653164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z77m"
Jul 24 14:26:33.703447 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:33.703395    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p7nwg" podStartSLOduration=61.354906016 podStartE2EDuration="1m30.703379669s" totalImagesPullingTime="29.348473653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:11.696076106 +0000 UTC m=+236.084096222" watchObservedRunningTime="2026-07-24 14:26:33.703379669 +0000 UTC m=+258.091399785"
Jul 24 14:26:34.183410 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:34.183375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:34.183622 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:34.183493    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:34.183622 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:34.183545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:34.183740 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:34.183711    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:35.183658 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:35.183618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:35.184047 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:35.183748    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:36.156252 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:36.156213    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:36.184374 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:36.184337    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:36.184865 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:36.184461    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:36.184865 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:36.184501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:36.184865 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:36.184603    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:37.183989 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:37.183863    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:37.184152 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:37.184000    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:38.183584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:38.183523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:38.183584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:38.183591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:38.184141 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:38.183673    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:38.184141 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:38.183783    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:39.183472 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:39.183434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:39.183691 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:39.183547    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:40.040139 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.040079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:40.040139 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.040136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:40.040366 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.040231    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:40.040366 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.040236    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:40.040366 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.040308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs podName:c20e1114-ba31-4b6c-b2e8-9e2f5ec04904 nodeName:}" failed. No retries permitted until 2026-07-24 14:27:44.040270582 +0000 UTC m=+328.428290676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs") pod "network-metrics-daemon-jb6g4" (UID: "c20e1114-ba31-4b6c-b2e8-9e2f5ec04904") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 14:26:40.040366 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.040321    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret podName:3f0275c3-34a2-49dd-86e1-1f90c3139a98 nodeName:}" failed. No retries permitted until 2026-07-24 14:27:44.04031505 +0000 UTC m=+328.428335144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret") pod "global-pull-secret-syncer-6gv2s" (UID: "3f0275c3-34a2-49dd-86e1-1f90c3139a98") : object "kube-system"/"original-pull-secret" not registered
Jul 24 14:26:40.141093 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.141046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:40.141238 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.141216    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 14:26:40.141281 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.141245    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 14:26:40.141281 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.141255    2560 projected.go:196] Error preparing data for projected volume kube-api-access-9l2pk for pod openshift-network-diagnostics/network-check-target-7rjwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:40.141341 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.141307    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk podName:6426fe20-f508-4950-851b-14645d156969 nodeName:}" failed. No retries permitted until 2026-07-24 14:27:44.141292659 +0000 UTC m=+328.529312753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l2pk" (UniqueName: "kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk") pod "network-check-target-7rjwp" (UID: "6426fe20-f508-4950-851b-14645d156969") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 14:26:40.155548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.155517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:40.183687 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.183662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:40.184021 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:40.183669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:40.184021 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.183771    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:40.184021 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:40.183841    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:41.157152 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:41.157118    2560 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Jul 24 14:26:41.183434 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:41.183383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:41.183619 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:41.183511    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:42.184053 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:42.184010    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:42.184438 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:42.184010    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:42.184438 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:42.184144    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:42.184438 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:42.184210    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:43.183955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:43.183899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:43.184160 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:43.184026    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:44.183770 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:44.183732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:44.183953 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:44.183732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:44.183953 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:44.183844    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7rjwp" podUID="6426fe20-f508-4950-851b-14645d156969"
Jul 24 14:26:44.183953 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:44.183928    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb6g4" podUID="c20e1114-ba31-4b6c-b2e8-9e2f5ec04904"
Jul 24 14:26:44.949312 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:44.949277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.144747 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.144715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.184139 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.184108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:45.184240 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:45.184221    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gv2s" podUID="3f0275c3-34a2-49dd-86e1-1f90c3139a98"
Jul 24 14:26:45.269754 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.269673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.423884 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.423855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.525776 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.525684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.639171 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.639142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.770110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.770083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:45.879740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:45.879695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:46.186738 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.186652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:26:46.187146 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.186825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:26:46.189856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.189838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xh5fm\""
Jul 24 14:26:46.190850 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.190835    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:26:46.190965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.190948    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:26:46.191011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.190948    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbcqt\""
Jul 24 14:26:46.191011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:46.190970    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:26:47.183187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:47.183147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:26:47.186527 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:47.186503    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:26:48.042612 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:48.042546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:48.143460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:48.143418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:48.241986 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:48.241952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:48.883883 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:48.883852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:48.963314 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:48.963269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:50.651317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:50.651289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:50.776387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:50.776357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:53.678222 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:53.678191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:55.317906 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:55.317869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:55.748136 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:55.748108    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeReady"
Jul 24 14:26:55.770909 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:55.770854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:56.038915 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.038818    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"]
Jul 24 14:26:56.041233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.041217    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r5k7g"]
Jul 24 14:26:56.041358 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.041340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.042965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.042948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.084297 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.084234    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-tls\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" type="*v1.Secret"
Jul 24 14:26:56.084582 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.084328    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:56.084582 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.084450    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-dockercfg-9nh4q\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9nh4q\"" type="*v1.Secret"
Jul 24 14:26:56.084720 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.084581    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"openshift-state-metrics-b8f49f5c6-sch7f\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="0099bc23-4cbe-4cbd-928c-5375928a98ab" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.084965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.084947    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qt4kj"]
Jul 24 14:26:56.086884 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.086866    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"]
Jul 24 14:26:56.087018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.087002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.088826 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.088805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.107939 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.107907    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret"
Jul 24 14:26:56.108072 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.107937    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap"
Jul 24 14:26:56.108790 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108766    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:56.108869 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108787    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-w26gz\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w26gz\"" type="*v1.Secret"
Jul 24 14:26:56.108869 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108799    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 24 14:26:56.108869 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108822    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 24 14:26:56.108869 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108825    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:56.108869 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:56.108845    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 24 14:26:56.118314 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118323    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h249t\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118334    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118356    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5jncb\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118292    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 14:26:56.118448 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.118292    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 14:26:56.141788 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.141762    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt4kj"]
Jul 24 14:26:56.142531 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.142507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"]
Jul 24 14:26:56.143227 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.143209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5k7g"]
Jul 24 14:26:56.156381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6qq\" (UniqueName: \"kubernetes.io/projected/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-api-access-sc6qq\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.156381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjm47\" (UniqueName: \"kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.156585 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6631cc0-d090-497c-b60d-42a7b9105290-config-volume\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.156585 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w95zk\" (UniqueName: \"kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.156585 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.156702 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.156702 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.156702 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-crio-socket\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.156802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6631cc0-d090-497c-b60d-42a7b9105290-tmp-dir\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.156802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.156802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.156904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.156904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.156904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.157026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6631cc0-d090-497c-b60d-42a7b9105290-metrics-tls\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.157026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbbj\" (UniqueName: \"kubernetes.io/projected/d6631cc0-d090-497c-b60d-42a7b9105290-kube-api-access-rcbbj\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.157026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.157026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.157026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.156987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-data-volume\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.172124 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.172091    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"]
Jul 24 14:26:56.193161 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.193126    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mfnwk"]
Jul 24 14:26:56.194946 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.194930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.202457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.202434    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 14:26:56.202630 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.202465    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 14:26:56.203792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.203776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6vcpp\""
Jul 24 14:26:56.203882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.203813    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 14:26:56.233984 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.233946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfnwk"]
Jul 24 14:26:56.257342 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6qq\" (UniqueName: \"kubernetes.io/projected/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-api-access-sc6qq\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.257513 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjm47\" (UniqueName: \"kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.257513 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6631cc0-d090-497c-b60d-42a7b9105290-config-volume\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.257513 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w95zk\" (UniqueName: \"kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.257652 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.257652 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.257839 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.257839 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-crio-socket\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.258034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6631cc0-d090-497c-b60d-42a7b9105290-tmp-dir\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.258034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.258034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.258034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.258034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.257986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:56.258317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6631cc0-d090-497c-b60d-42a7b9105290-config-volume\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.258469 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.258535 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6631cc0-d090-497c-b60d-42a7b9105290-tmp-dir\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.258535 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51936153-9ec5-4b86-938f-4b442a16d6d6-cert\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.258674 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6631cc0-d090-497c-b60d-42a7b9105290-metrics-tls\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.258674 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-crio-socket\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.258674 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbbj\" (UniqueName: \"kubernetes.io/projected/d6631cc0-d090-497c-b60d-42a7b9105290-kube-api-access-rcbbj\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.258674 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.258854 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbmr\" (UniqueName: \"kubernetes.io/projected/51936153-9ec5-4b86-938f-4b442a16d6d6-kube-api-access-zkbmr\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.259068 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.258865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.259258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.259094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-data-volume\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.259348 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.259326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.262220 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.262150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-data-volume\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:56.262220 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.262170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.264511 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.264218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6631cc0-d090-497c-b60d-42a7b9105290-metrics-tls\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.264511 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.264227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.264511 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.264296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:56.275537 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.275504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbbj\" (UniqueName: \"kubernetes.io/projected/d6631cc0-d090-497c-b60d-42a7b9105290-kube-api-access-rcbbj\") pod \"dns-default-qt4kj\" (UID: \"d6631cc0-d090-497c-b60d-42a7b9105290\") " pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.329242 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.329152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:56.360487 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.360448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51936153-9ec5-4b86-938f-4b442a16d6d6-cert\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.360487 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.360486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbmr\" (UniqueName: \"kubernetes.io/projected/51936153-9ec5-4b86-938f-4b442a16d6d6-kube-api-access-zkbmr\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.363009 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.362987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51936153-9ec5-4b86-938f-4b442a16d6d6-cert\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.371549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.371523    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jwhf7"]
Jul 24 14:26:56.374208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.374191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.381516 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.381499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmr2w\""
Jul 24 14:26:56.381618 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.381499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 14:26:56.396936 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.396901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:56.408027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.407994    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 14:26:56.408158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.408030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 14:26:56.410865 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.410841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbmr\" (UniqueName: \"kubernetes.io/projected/51936153-9ec5-4b86-938f-4b442a16d6d6-kube-api-access-zkbmr\") pod \"ingress-canary-mfnwk\" (UID: \"51936153-9ec5-4b86-938f-4b442a16d6d6\") " pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.461185 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-root\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-sys\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461466 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461505 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rwb8\" (UniqueName: \"kubernetes.io/projected/b7b00859-4a46-4d22-8361-d694fe366590-kube-api-access-5rwb8\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461608 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-wtmp\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461675 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-textfile\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.461675 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.461648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-tls\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.503615 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.503586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfnwk"
Jul 24 14:26:56.555480 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.555095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qt4kj"]
Jul 24 14:26:56.561345 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:26:56.561301    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6631cc0_d090_497c_b60d_42a7b9105290.slice/crio-ab6625cd1b50155506c1c9e9d621677c8d00052837e0e960b851e7c48a55322b WatchSource:0}: Error finding container ab6625cd1b50155506c1c9e9d621677c8d00052837e0e960b851e7c48a55322b: Status 404 returned error can't find the container with id ab6625cd1b50155506c1c9e9d621677c8d00052837e0e960b851e7c48a55322b
Jul 24 14:26:56.562608 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rwb8\" (UniqueName: \"kubernetes.io/projected/b7b00859-4a46-4d22-8361-d694fe366590-kube-api-access-5rwb8\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-wtmp\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-textfile\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-tls\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-root\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-sys\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.562917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-wtmp\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.563130 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.562956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-sys\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.563130 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.563048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7b00859-4a46-4d22-8361-d694fe366590-root\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.563228 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.563182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-textfile\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.563576 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.563483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.565593 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.565545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-tls\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.568698 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.568678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7b00859-4a46-4d22-8361-d694fe366590-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:56.578949 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.578917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:56.640498 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.640462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfnwk"]
Jul 24 14:26:56.643919 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:26:56.643892    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51936153_9ec5_4b86_938f_4b442a16d6d6.slice/crio-d0dcce4ff810318cc7e881aa45df20798447ba7c977b040afe0b2d64df965142 WatchSource:0}: Error finding container d0dcce4ff810318cc7e881aa45df20798447ba7c977b040afe0b2d64df965142: Status 404 returned error can't find the container with id d0dcce4ff810318cc7e881aa45df20798447ba7c977b040afe0b2d64df965142
Jul 24 14:26:56.699205 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.699168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:56.766676 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.766633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfnwk" event={"ID":"51936153-9ec5-4b86-938f-4b442a16d6d6","Type":"ContainerStarted","Data":"d0dcce4ff810318cc7e881aa45df20798447ba7c977b040afe0b2d64df965142"}
Jul 24 14:26:56.767518 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.767494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt4kj" event={"ID":"d6631cc0-d090-497c-b60d-42a7b9105290","Type":"ContainerStarted","Data":"ab6625cd1b50155506c1c9e9d621677c8d00052837e0e960b851e7c48a55322b"}
Jul 24 14:26:56.893052 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.893013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:56.927289 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:56.927258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 14:26:57.218004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.217919    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 14:26:57.223295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.223263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:57.225119 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.225022    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 14:26:57.228240 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.228205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6qq\" (UniqueName: \"kubernetes.io/projected/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-api-access-sc6qq\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:57.248451 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.248406    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9nh4q\""
Jul 24 14:26:57.248800 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.248780    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w26gz\""
Jul 24 14:26:57.258670 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258467    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Jul 24 14:26:57.258670 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258525    2560 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.258670 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258585    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config podName:0099bc23-4cbe-4cbd-928c-5375928a98ab nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.758532895 +0000 UTC m=+282.146553003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config") pod "openshift-state-metrics-b8f49f5c6-sch7f" (UID: "0099bc23-4cbe-4cbd-928c-5375928a98ab") : failed to sync secret cache: timed out waiting for the condition
Jul 24 14:26:57.258961 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258689    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca podName:45cc87a3-eb4f-4e85-87ff-27e8f0994e6e nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.758629218 +0000 UTC m=+282.146649330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca") pod "kube-state-metrics-56d9f944b4-x56vv" (UID: "45cc87a3-eb4f-4e85-87ff-27e8f0994e6e") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.258961 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258772    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.258961 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.258822    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm podName:c3d3c469-b3c0-48c1-bb92-0adab569d4fa nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.75880697 +0000 UTC m=+282.146827082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r5k7g" (UID: "c3d3c469-b3c0-48c1-bb92-0adab569d4fa") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.259916 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.259895    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition
Jul 24 14:26:57.260020 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.259955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls podName:0099bc23-4cbe-4cbd-928c-5375928a98ab nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.759937458 +0000 UTC m=+282.147957572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-sch7f" (UID: "0099bc23-4cbe-4cbd-928c-5375928a98ab") : failed to sync secret cache: timed out waiting for the condition
Jul 24 14:26:57.260104 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.260086    2560 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.260173 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.260145    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca podName:0099bc23-4cbe-4cbd-928c-5375928a98ab nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.760130733 +0000 UTC m=+282.148150842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca") pod "openshift-state-metrics-b8f49f5c6-sch7f" (UID: "0099bc23-4cbe-4cbd-928c-5375928a98ab") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.272850 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.272820    2560 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.275103 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.275054    2560 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.333940 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.333896    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 14:26:57.395743 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.395694    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 14:26:57.403723 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.403679    2560 projected.go:196] Error preparing data for projected volume kube-api-access-wjm47 for pod openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.403882 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.403786    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47 podName:0099bc23-4cbe-4cbd-928c-5375928a98ab nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.903763893 +0000 UTC m=+282.291784003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wjm47" (UniqueName: "kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47") pod "openshift-state-metrics-b8f49f5c6-sch7f" (UID: "0099bc23-4cbe-4cbd-928c-5375928a98ab") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.406194 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.406163    2560 projected.go:196] Error preparing data for projected volume kube-api-access-w95zk for pod openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.406327 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.406246    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk podName:45cc87a3-eb4f-4e85-87ff-27e8f0994e6e nodeName:}" failed. No retries permitted until 2026-07-24 14:26:57.906224309 +0000 UTC m=+282.294244403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w95zk" (UniqueName: "kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk") pod "kube-state-metrics-56d9f944b4-x56vv" (UID: "45cc87a3-eb4f-4e85-87ff-27e8f0994e6e") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.406800 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.406762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rwb8\" (UniqueName: \"kubernetes.io/projected/b7b00859-4a46-4d22-8361-d694fe366590-kube-api-access-5rwb8\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:57.416460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.416426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 14:26:57.452943 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.452881    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 14:26:57.502340 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.502251    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 14:26:57.562755 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.562708    2560 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.562915 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:26:57.562805    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca podName:b7b00859-4a46-4d22-8361-d694fe366590 nodeName:}" failed. No retries permitted until 2026-07-24 14:26:58.0627815 +0000 UTC m=+282.450801608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca") pod "node-exporter-jwhf7" (UID: "b7b00859-4a46-4d22-8361-d694fe366590") : failed to sync configmap cache: timed out waiting for the condition
Jul 24 14:26:57.652066 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.652025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 14:26:57.725123 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.725084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:57.774364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.774282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.774364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.774322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:57.774627 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.774370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.774627 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.774458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:57.774627 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.774507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.775079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.775038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3d3c469-b3c0-48c1-bb92-0adab569d4fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5k7g\" (UID: \"c3d3c469-b3c0-48c1-bb92-0adab569d4fa\") " pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:57.775469 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.775357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0099bc23-4cbe-4cbd-928c-5375928a98ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.775745 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.775724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:57.777684 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.777666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.778319 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.778137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0099bc23-4cbe-4cbd-928c-5375928a98ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.856321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.856286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5k7g"
Jul 24 14:26:57.902693 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.902652    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:26:57.905710 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.905684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.912529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 14:26:57.912529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 14:26:57.912529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912014    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 14:26:57.912529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912116    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 14:26:57.912758 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 14:26:57.912900 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912772    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 14:26:57.913101 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 14:26:57.913101 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.912914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 14:26:57.916293 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.915477    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 14:26:57.919119 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.917783    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rwh77\""
Jul 24 14:26:57.945071 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.945029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:57.958872 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.958838    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:26:57.976003 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.975961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976195 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976195 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976296 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976296 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjm47\" (UniqueName: \"kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.976364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w95zk\" (UniqueName: \"kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:57.976457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976691 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976691 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976691 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976691 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.976691 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.976616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq25g\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:57.980402 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.980373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjm47\" (UniqueName: \"kubernetes.io/projected/0099bc23-4cbe-4cbd-928c-5375928a98ab-kube-api-access-wjm47\") pod \"openshift-state-metrics-b8f49f5c6-sch7f\" (UID: \"0099bc23-4cbe-4cbd-928c-5375928a98ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:57.981178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:57.981149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w95zk\" (UniqueName: \"kubernetes.io/projected/45cc87a3-eb4f-4e85-87ff-27e8f0994e6e-kube-api-access-w95zk\") pod \"kube-state-metrics-56d9f944b4-x56vv\" (UID: \"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:58.074027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.073993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5k7g"]
Jul 24 14:26:58.077692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.077832 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.077832 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.077832 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.077832 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077814    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq25g\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078037 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.077995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:58.078719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.078818 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.078722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b00859-4a46-4d22-8361-d694fe366590-metrics-client-ca\") pod \"node-exporter-jwhf7\" (UID: \"b7b00859-4a46-4d22-8361-d694fe366590\") " pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:58.079625 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.079540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.081373 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.080935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.081373 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.081323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.082271 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.082247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.082487 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.082464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.083291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.083265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.083372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.083308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.083372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.083346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.084090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.084066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.084332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.084290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.085398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.085369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.106286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.106242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq25g\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g\") pod \"alertmanager-main-0\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.151088 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.151035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"
Jul 24 14:26:58.183290 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.183257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwhf7"
Jul 24 14:26:58.200924 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.200889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"
Jul 24 14:26:58.222977 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.222925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:26:58.254631 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.254589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:58.471289 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:26:58.471250    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d3c469_b3c0_48c1_bb92_0adab569d4fa.slice/crio-43d32760d02e9e5b4a05c14fd1a9214f1728f5706d4ea8cccffa3990376f4947 WatchSource:0}: Error finding container 43d32760d02e9e5b4a05c14fd1a9214f1728f5706d4ea8cccffa3990376f4947: Status 404 returned error can't find the container with id 43d32760d02e9e5b4a05c14fd1a9214f1728f5706d4ea8cccffa3990376f4947
Jul 24 14:26:58.774435 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.774335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5k7g" event={"ID":"c3d3c469-b3c0-48c1-bb92-0adab569d4fa","Type":"ContainerStarted","Data":"43d32760d02e9e5b4a05c14fd1a9214f1728f5706d4ea8cccffa3990376f4947"}
Jul 24 14:26:58.846704 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.846653    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6dffdc588-z2k9b"]
Jul 24 14:26:58.849625 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.849595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.859114 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.859057    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 14:26:58.859114 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.859057    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 14:26:58.859472 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.859448    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 14:26:58.859614 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.859515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 14:26:58.860287 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.860264    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 14:26:58.860395 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.860276    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l88j2\""
Jul 24 14:26:58.860460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.860393    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ihma4cgouv1v\""
Jul 24 14:26:58.890759 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.890726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dffdc588-z2k9b"]
Jul 24 14:26:58.988045 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hs62\" (UniqueName: \"kubernetes.io/projected/66352125-bb1d-43e0-9397-0991a540561f-kube-api-access-4hs62\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-grpc-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66352125-bb1d-43e0-9397-0991a540561f-metrics-client-ca\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:58.988470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:58.988347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089595 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089595 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hs62\" (UniqueName: \"kubernetes.io/projected/66352125-bb1d-43e0-9397-0991a540561f-kube-api-access-4hs62\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-grpc-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66352125-bb1d-43e0-9397-0991a540561f-metrics-client-ca\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.089837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.089810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.090749 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.090711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66352125-bb1d-43e0-9397-0991a540561f-metrics-client-ca\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093080 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.092878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093080 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.092889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093080 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.093033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093318 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.093296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093504 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.093464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-grpc-tls\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.093742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.093719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66352125-bb1d-43e0-9397-0991a540561f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.105472 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.105445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hs62\" (UniqueName: \"kubernetes.io/projected/66352125-bb1d-43e0-9397-0991a540561f-kube-api-access-4hs62\") pod \"thanos-querier-6dffdc588-z2k9b\" (UID: \"66352125-bb1d-43e0-9397-0991a540561f\") " pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.160370 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.160327    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:26:59.456479 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.456435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv"]
Jul 24 14:26:59.460493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.460398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:26:59.476658 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:26:59.476609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cc87a3_eb4f_4e85_87ff_27e8f0994e6e.slice/crio-4eb6c72119cf032208e1d87afb201202970c97bfae3ff4f97d394b0c7defa7a3 WatchSource:0}: Error finding container 4eb6c72119cf032208e1d87afb201202970c97bfae3ff4f97d394b0c7defa7a3: Status 404 returned error can't find the container with id 4eb6c72119cf032208e1d87afb201202970c97bfae3ff4f97d394b0c7defa7a3
Jul 24 14:26:59.498279 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.498246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f"]
Jul 24 14:26:59.517712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.517539    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dffdc588-z2k9b"]
Jul 24 14:26:59.519672 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.519496    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:26:59.524462 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:26:59.524433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66352125_bb1d_43e0_9397_0991a540561f.slice/crio-f4dbc45342eda77f208f4c305376e171f48019e4b141a094afb8aac36eb1c62c WatchSource:0}: Error finding container f4dbc45342eda77f208f4c305376e171f48019e4b141a094afb8aac36eb1c62c: Status 404 returned error can't find the container with id f4dbc45342eda77f208f4c305376e171f48019e4b141a094afb8aac36eb1c62c
Jul 24 14:26:59.782115 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.782066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f" event={"ID":"0099bc23-4cbe-4cbd-928c-5375928a98ab","Type":"ContainerStarted","Data":"d54a69f62a4dfc2ef62b3a3ffdae417954fce8496e0e2e874566dd069c71e52b"}
Jul 24 14:26:59.782316 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.782150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f" event={"ID":"0099bc23-4cbe-4cbd-928c-5375928a98ab","Type":"ContainerStarted","Data":"801d721e8575a7f2d9e9c5ac8bcdd87f5c9bbf76fdd895b04f62085b9bf7b014"}
Jul 24 14:26:59.782316 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.782180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f" event={"ID":"0099bc23-4cbe-4cbd-928c-5375928a98ab","Type":"ContainerStarted","Data":"7ab88b6e1eb8c3583160f784f9556ac3478142d2faf5b42bfb42c0c8dd69b7d8"}
Jul 24 14:26:59.785096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.785061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt4kj" event={"ID":"d6631cc0-d090-497c-b60d-42a7b9105290","Type":"ContainerStarted","Data":"9d7053784e3e2d0bf719ff1344724c2a9227b1d4d0123f2f4a7e6202ccbec805"}
Jul 24 14:26:59.785228 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.785130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qt4kj" event={"ID":"d6631cc0-d090-497c-b60d-42a7b9105290","Type":"ContainerStarted","Data":"9c7f3947054b6e808d41eda54d2afdd43f5b20227e02e47a8628cbd5707c4e7c"}
Jul 24 14:26:59.785327 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.785278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:26:59.786968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.786883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv" event={"ID":"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e","Type":"ContainerStarted","Data":"4eb6c72119cf032208e1d87afb201202970c97bfae3ff4f97d394b0c7defa7a3"}
Jul 24 14:26:59.789181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.789053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfnwk" event={"ID":"51936153-9ec5-4b86-938f-4b442a16d6d6","Type":"ContainerStarted","Data":"6cd32f6a3bdaae665850b8e03533802c72837d9149d0ca05a7d0a679a0042685"}
Jul 24 14:26:59.792371 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.792294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"4b825c5ef73d37b72e1b94b4d29979f05144a906780f83ac5a001c5e837a0b24"}
Jul 24 14:26:59.794030 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.793946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"f4dbc45342eda77f208f4c305376e171f48019e4b141a094afb8aac36eb1c62c"}
Jul 24 14:26:59.795584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.795488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhf7" event={"ID":"b7b00859-4a46-4d22-8361-d694fe366590","Type":"ContainerStarted","Data":"e1ff9f393e92dc16e9e773aac71e5081b0d65d1d95f9917d76f36a0f0bf8b48b"}
Jul 24 14:26:59.810950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.810198    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qt4kj" podStartSLOduration=2.152893192 podStartE2EDuration="4.810174168s" totalImagesPullingTime="2.657280976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:59.809132578 +0000 UTC m=+284.197152695" watchObservedRunningTime="2026-07-24 14:26:59.810174168 +0000 UTC m=+284.198194289"
Jul 24 14:26:59.841768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.840482    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mfnwk" podStartSLOduration=1.257448178 podStartE2EDuration="3.840460104s" totalImagesPullingTime="2.583011926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:59.839926874 +0000 UTC m=+284.227946992" watchObservedRunningTime="2026-07-24 14:26:59.840460104 +0000 UTC m=+284.228480223"
Jul 24 14:26:59.858957 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:26:59.858836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.005904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.005824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.169964 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.169848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.389598 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.389482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.562803 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.562715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.659154 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.658022    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-74b464c774-n5gtg"]
Jul 24 14:27:00.662258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.661770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.667588 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.667195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 14:27:00.667965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.667806    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 14:27:00.669162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.668770    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 14:27:00.669162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.669007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-89fli45l1f25v\""
Jul 24 14:27:00.669580 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.669378    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 14:27:00.676244 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.676021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zvj5m\""
Jul 24 14:27:00.693540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.693503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74b464c774-n5gtg"]
Jul 24 14:27:00.728668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.728612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:00.809232 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-client-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-tls\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-metrics-server-audit-profiles\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mx6s\" (UniqueName: \"kubernetes.io/projected/b17410ad-2827-47c7-af64-26d31dd87f47-kube-api-access-4mx6s\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b17410ad-2827-47c7-af64-26d31dd87f47-audit-log\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809681 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.809681 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.809624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-client-certs\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.911589 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.910903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-tls\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.911589 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.910975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-metrics-server-audit-profiles\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.911589 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.911031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mx6s\" (UniqueName: \"kubernetes.io/projected/b17410ad-2827-47c7-af64-26d31dd87f47-kube-api-access-4mx6s\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.911589 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.911071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b17410ad-2827-47c7-af64-26d31dd87f47-audit-log\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.912492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.912173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-metrics-server-audit-profiles\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.912492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.912278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.912492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.912349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-client-certs\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.912492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.912391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-client-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.912817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.912698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b17410ad-2827-47c7-af64-26d31dd87f47-audit-log\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.913340 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.913298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b17410ad-2827-47c7-af64-26d31dd87f47-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.916215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.916173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-client-ca-bundle\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.917236 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.917196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-client-certs\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.922794 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.922745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b17410ad-2827-47c7-af64-26d31dd87f47-secret-metrics-server-tls\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.940434 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.940397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mx6s\" (UniqueName: \"kubernetes.io/projected/b17410ad-2827-47c7-af64-26d31dd87f47-kube-api-access-4mx6s\") pod \"metrics-server-74b464c774-n5gtg\" (UID: \"b17410ad-2827-47c7-af64-26d31dd87f47\") " pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:00.976602 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:00.976260    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:01.054743 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.054712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:01.264692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.264592    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58f67fd986-cwf84"]
Jul 24 14:27:01.267269 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.267234    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.280783 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.280752    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 14:27:01.282382 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.282341    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 14:27:01.282846 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.282823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-62v9q\""
Jul 24 14:27:01.284546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.284525    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 14:27:01.288991 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.288889    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 14:27:01.289427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.289409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 14:27:01.297828 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.297800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 14:27:01.359688 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.359601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58f67fd986-cwf84"]
Jul 24 14:27:01.417811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.417811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-serving-certs-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.417811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.418102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-federate-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.418102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-telemeter-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.418102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.417985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmdk\" (UniqueName: \"kubernetes.io/projected/54160696-41fd-4b22-aa17-799987782367-kube-api-access-kqmdk\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.418102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.418009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-metrics-client-ca\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.418102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.418027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.490137 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.490097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.520949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-serving-certs-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-federate-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-telemeter-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmdk\" (UniqueName: \"kubernetes.io/projected/54160696-41fd-4b22-aa17-799987782367-kube-api-access-kqmdk\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-metrics-client-ca\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.521777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.521527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.523801 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.523348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.524791 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.524683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-metrics-client-ca\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.528436 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.525521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54160696-41fd-4b22-aa17-799987782367-serving-certs-ca-bundle\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.529742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.529261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.529742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.529383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-secret-telemeter-client\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.531429 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.531403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-federate-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.531626 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.531604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/54160696-41fd-4b22-aa17-799987782367-telemeter-client-tls\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.544928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.544873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmdk\" (UniqueName: \"kubernetes.io/projected/54160696-41fd-4b22-aa17-799987782367-kube-api-access-kqmdk\") pod \"telemeter-client-58f67fd986-cwf84\" (UID: \"54160696-41fd-4b22-aa17-799987782367\") " pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.580058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.579698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84"
Jul 24 14:27:01.670820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:01.670786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:03.337949 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.337910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:03.347205 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.347174    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:27:03.361985 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.361951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.367339 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.367311    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 14:27:03.367773 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.367747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20i42a3ok6t0j\""
Jul 24 14:27:03.367924 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.367747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 14:27:03.367924 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.367759    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 14:27:03.369724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.369657    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 14:27:03.370059 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.370042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kptwd\""
Jul 24 14:27:03.370158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.370065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 14:27:03.370363 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.370345    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 14:27:03.371129 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.370864    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 14:27:03.371200 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.371132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 14:27:03.371412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.371291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 14:27:03.371760 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.371726    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 14:27:03.371760 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.371753    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 14:27:03.372909 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.372888    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 14:27:03.373011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.372925    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 14:27:03.380655 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.380629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:27:03.381303 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.381278    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 14:27:03.504573 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.504520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:03.542803 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.542803 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.542999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrmxc\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543062 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.543820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.543458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.644908 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.644867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.644929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.644959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.644985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrmxc\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645543 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645873 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645935 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.645935 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.645983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.646258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.647758 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.647758 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.647141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.648291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.648174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.648291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.648182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.648698 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.648673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.649215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.648863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.649215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.646248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.649439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.649545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.650246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.650659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.651347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.651545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.651490    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.652377 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.652336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.652635 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.652610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.652766 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.652746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.653535 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.653517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.653754 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.653735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.658356 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.658335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrmxc\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc\") pod \"prometheus-k8s-0\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.675449 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.675378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:03.872742 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:03.872712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:04.018482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:04.018375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:04.402424 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:04.401359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74b464c774-n5gtg"]
Jul 24 14:27:04.448631 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:04.448467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58f67fd986-cwf84"]
Jul 24 14:27:04.841860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:04.841827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:04.957337 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:27:04.957277    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54160696_41fd_4b22_aa17_799987782367.slice/crio-5b08a8106d9542564cf4dd30194e63281576b9097634822b5937bcb4549e800f WatchSource:0}: Error finding container 5b08a8106d9542564cf4dd30194e63281576b9097634822b5937bcb4549e800f: Status 404 returned error can't find the container with id 5b08a8106d9542564cf4dd30194e63281576b9097634822b5937bcb4549e800f
Jul 24 14:27:04.958142 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:27:04.957874    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17410ad_2827_47c7_af64_26d31dd87f47.slice/crio-3ce4729214dd3324eace80c5ac4335ac0d56fce7c0e024c6c2bf5581f9b57c4a WatchSource:0}: Error finding container 3ce4729214dd3324eace80c5ac4335ac0d56fce7c0e024c6c2bf5581f9b57c4a: Status 404 returned error can't find the container with id 3ce4729214dd3324eace80c5ac4335ac0d56fce7c0e024c6c2bf5581f9b57c4a
Jul 24 14:27:05.023912 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.023878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:05.149591 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.149444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:27:05.440802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.440735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:05.577380 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.577297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:05.821427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.820363    2560 generic.go:356] "Generic (PLEG): container finished" podID="b7b00859-4a46-4d22-8361-d694fe366590" containerID="6c96f4b034f627b0358b1c251f751c425dcf9edab769e312dcf3d8567d74063a" exitCode=0
Jul 24 14:27:05.821427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.820455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhf7" event={"ID":"b7b00859-4a46-4d22-8361-d694fe366590","Type":"ContainerDied","Data":"6c96f4b034f627b0358b1c251f751c425dcf9edab769e312dcf3d8567d74063a"}
Jul 24 14:27:05.823407 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.823315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg" event={"ID":"b17410ad-2827-47c7-af64-26d31dd87f47","Type":"ContainerStarted","Data":"3ce4729214dd3324eace80c5ac4335ac0d56fce7c0e024c6c2bf5581f9b57c4a"}
Jul 24 14:27:05.828302 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.828264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f" event={"ID":"0099bc23-4cbe-4cbd-928c-5375928a98ab","Type":"ContainerStarted","Data":"42dcba38a7581d19902306ae5933c63b1368a042dba16f59fb405bf0a296183e"}
Jul 24 14:27:05.833633 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.832995    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663" exitCode=0
Jul 24 14:27:05.833633 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.833096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"}
Jul 24 14:27:05.833633 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.833176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"bd7bcfc86029718493d4a668b559dd3292d6e767c61bf70ce1b3972c77fe36bf"}
Jul 24 14:27:05.837020 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.836989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv" event={"ID":"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e","Type":"ContainerStarted","Data":"19e6a4cae0618aef3c74f5135cde14fb3eb696c2185ce34e20b1ef93f9430195"}
Jul 24 14:27:05.837123 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.837055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv" event={"ID":"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e","Type":"ContainerStarted","Data":"a27b413831001c8943c4b128d07ab3e7035f1824fd7e625de8014b83ae95c271"}
Jul 24 14:27:05.837123 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.837079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv" event={"ID":"45cc87a3-eb4f-4e85-87ff-27e8f0994e6e","Type":"ContainerStarted","Data":"39dee285ab5b46d41cf81947974c079f70a2b4f83c5447983f16583da868b4be"}
Jul 24 14:27:05.839758 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.839677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84" event={"ID":"54160696-41fd-4b22-aa17-799987782367","Type":"ContainerStarted","Data":"5b08a8106d9542564cf4dd30194e63281576b9097634822b5937bcb4549e800f"}
Jul 24 14:27:05.841889 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.841828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5k7g" event={"ID":"c3d3c469-b3c0-48c1-bb92-0adab569d4fa","Type":"ContainerStarted","Data":"50cd48796e92678d252a572b66098a29f872304ba644e66262571639aac0580c"}
Jul 24 14:27:05.844442 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.843676    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000" exitCode=0
Jul 24 14:27:05.844442 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.843808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000"}
Jul 24 14:27:05.846925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.846900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"1351c18ee217cedeb282d04b0b371e15f019983075e499d080d3a80b41438e7f"}
Jul 24 14:27:05.847012 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.846974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"9125afa542b9d30ec7a11e29ba0ec31c65d6b262b96059524ec2dddb0fcd10a6"}
Jul 24 14:27:05.847069 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:05.847015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"48b1160b3bd0628a884c54ef5b82538d5414326f79a31b76038891d9761f6ef3"}
Jul 24 14:27:06.001268 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.000100    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-sch7f" podStartSLOduration=6.396389956 podStartE2EDuration="11.000077166s" totalImagesPullingTime="4.60368721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:05.99783243 +0000 UTC m=+290.385852559" watchObservedRunningTime="2026-07-24 14:27:06.000077166 +0000 UTC m=+290.388097312"
Jul 24 14:27:06.090458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.090386    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-x56vv" podStartSLOduration=6.293950804 podStartE2EDuration="11.090362466s" totalImagesPullingTime="4.796411662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:06.087198626 +0000 UTC m=+290.475218743" watchObservedRunningTime="2026-07-24 14:27:06.090362466 +0000 UTC m=+290.478382574"
Jul 24 14:27:06.481002 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.480922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:06.621223 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.621152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:06.858962 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.858843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhf7" event={"ID":"b7b00859-4a46-4d22-8361-d694fe366590","Type":"ContainerStarted","Data":"22d6493cb062524a35118b3bb02d6b7acb05367829cc8fe9a8e598c8b39e01e7"}
Jul 24 14:27:06.858962 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.858901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhf7" event={"ID":"b7b00859-4a46-4d22-8361-d694fe366590","Type":"ContainerStarted","Data":"07b9b295290d2aa64591b76c6a6d3a1902c20d48aec1c3ca7e03d9038b8ffc4f"}
Jul 24 14:27:06.894147 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:06.893842    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jwhf7" podStartSLOduration=7.760653606 podStartE2EDuration="10.893817731s" totalImagesPullingTime="3.006123037s" totalInitContainerRuntime="127.041088ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:06.892141669 +0000 UTC m=+291.280161813" watchObservedRunningTime="2026-07-24 14:27:06.893817731 +0000 UTC m=+291.281837848"
Jul 24 14:27:07.069489 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:07.069419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:07.272086 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:07.272001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:07.922599 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:07.922540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:08.070266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:08.070236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:09.802307 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:09.802214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qt4kj"
Jul 24 14:27:11.574959 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.574819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:11.669010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.668982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:11.882572 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.882533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5k7g" event={"ID":"c3d3c469-b3c0-48c1-bb92-0adab569d4fa","Type":"ContainerStarted","Data":"d35ed1da6efd4977cdd150575361c653933391073b2ccffd70e19254bd0b04f0"}
Jul 24 14:27:11.886125 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"}
Jul 24 14:27:11.886266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"}
Jul 24 14:27:11.886266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886200    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"}
Jul 24 14:27:11.886266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"}
Jul 24 14:27:11.886450 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"}
Jul 24 14:27:11.886450 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.886321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerStarted","Data":"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"}
Jul 24 14:27:11.889438 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.889410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"922e73f4268b705f8f721799f2ae5dfc33d56710c8ce9a833482018345a9d5cf"}
Jul 24 14:27:11.889602 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.889465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"32fc85a594b0fcd1cee940806cd29110912b6d15ab3d23c590d2d5f5b23c42a4"}
Jul 24 14:27:11.889602 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.889502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" event={"ID":"66352125-bb1d-43e0-9397-0991a540561f","Type":"ContainerStarted","Data":"3f736768e139a537958cb6a4c059beaceb4c36327f7d0486e84eca5794d470bb"}
Jul 24 14:27:11.889602 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.889544    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:27:11.891201 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.891171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg" event={"ID":"b17410ad-2827-47c7-af64-26d31dd87f47","Type":"ContainerStarted","Data":"3cc442003f86d544e111aa4dfc9eeab079d21fc225b9e28293d96fe32a99eb4f"}
Jul 24 14:27:11.895041 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"}
Jul 24 14:27:11.895169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"}
Jul 24 14:27:11.895169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"}
Jul 24 14:27:11.895169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"}
Jul 24 14:27:11.895338 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"}
Jul 24 14:27:11.895338 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.895210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerStarted","Data":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"}
Jul 24 14:27:11.896845 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.896822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b"
Jul 24 14:27:11.897806 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.897786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84" event={"ID":"54160696-41fd-4b22-aa17-799987782367","Type":"ContainerStarted","Data":"9dfaffd7d0f54441c768f367334914f9fe9bc44436fd05e7ad4fcda1b6e99237"}
Jul 24 14:27:11.897902 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.897825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84" event={"ID":"54160696-41fd-4b22-aa17-799987782367","Type":"ContainerStarted","Data":"f067711535f41480c54f5fae8590d8bcb252a5914a385ae3a2b2c4e37498a743"}
Jul 24 14:27:11.897902 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.897842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84" event={"ID":"54160696-41fd-4b22-aa17-799987782367","Type":"ContainerStarted","Data":"21589573215d0e35536a75b211d620f6c9e9981fa30312b8378d810dfba09a85"}
Jul 24 14:27:11.927482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.927426    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.770286441 podStartE2EDuration="14.92740995s" totalImagesPullingTime="10.124319475s" totalInitContainerRuntime="32.804034ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:11.926758818 +0000 UTC m=+296.314778949" watchObservedRunningTime="2026-07-24 14:27:11.92740995 +0000 UTC m=+296.315430067"
Jul 24 14:27:11.978849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.978683    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.555112898 podStartE2EDuration="8.97865668s" totalImagesPullingTime="5.39131169s" totalInitContainerRuntime="32.232092ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:11.976239172 +0000 UTC m=+296.364259313" watchObservedRunningTime="2026-07-24 14:27:11.97865668 +0000 UTC m=+296.366676775"
Jul 24 14:27:11.998461 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:11.998402    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg" podStartSLOduration=5.748593541 podStartE2EDuration="11.998383461s" totalImagesPullingTime="6.24978992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:11.996676807 +0000 UTC m=+296.384696943" watchObservedRunningTime="2026-07-24 14:27:11.998383461 +0000 UTC m=+296.386403555"
Jul 24 14:27:12.030311 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:12.030250    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58f67fd986-cwf84" podStartSLOduration=4.775336536 podStartE2EDuration="11.030232265s" totalImagesPullingTime="6.254895729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:12.029294915 +0000 UTC m=+296.417315043" watchObservedRunningTime="2026-07-24 14:27:12.030232265 +0000 UTC m=+296.418252359"
Jul 24 14:27:12.064662 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:12.064588    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6dffdc588-z2k9b" podStartSLOduration=3.532682151 podStartE2EDuration="14.064548584s" totalImagesPullingTime="10.531866433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:12.06285512 +0000 UTC m=+296.450875236" watchObservedRunningTime="2026-07-24 14:27:12.064548584 +0000 UTC m=+296.452568702"
Jul 24 14:27:12.844611 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:12.844575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:12.924225 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:12.924182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:13.675864 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:13.675821    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:27:15.505651 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:15.505524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:15.620709 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:15.620674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:15.737420 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:15.737387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:15.919314 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:15.919278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5k7g" event={"ID":"c3d3c469-b3c0-48c1-bb92-0adab569d4fa","Type":"ContainerStarted","Data":"0287c95323bcc9b76322a9eb2e44eb6eeae223cb91a8a1ea0cda01d67cc0016b"}
Jul 24 14:27:15.956507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:15.956450    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r5k7g" podStartSLOduration=3.516840727 podStartE2EDuration="19.956433254s" totalImagesPullingTime="16.439592527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:26:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:15.955201164 +0000 UTC m=+300.343221279" watchObservedRunningTime="2026-07-24 14:27:15.956433254 +0000 UTC m=+300.344453370"
Jul 24 14:27:16.077111 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:16.077085    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 14:27:19.098902 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:19.098862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:19.290861 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:19.290822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:20.976848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:20.976810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:20.977260 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:20.976875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:22.454171 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:22.454119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:22.561101 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:22.561055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:24.109526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:24.109488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:24.207871 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:24.207835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:24.308275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:24.308238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:27.240805 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:27.240773    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:27.329185 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:27.329146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:29.963090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:29.963044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:30.119387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:30.119356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:30.615179 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:30.615147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:30.697061 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:30.697029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:35.671608 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:35.671576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:35.752727 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:35.752697    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfnwk_51936153-9ec5-4b86-938f-4b442a16d6d6/serve-healthcheck-canary/0.log"
Jul 24 14:27:35.784908 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:35.784878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:38.169839 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:38.169803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:38.332004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:38.331970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:38.410705 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:38.410672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:40.982849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:40.982817    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:40.986777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:40.986748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-74b464c774-n5gtg"
Jul 24 14:27:44.130711 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.130671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:27:44.131163 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.130755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:27:44.133523 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.133500    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 14:27:44.134393 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.134379    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 14:27:44.143772 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.143740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f0275c3-34a2-49dd-86e1-1f90c3139a98-original-pull-secret\") pod \"global-pull-secret-syncer-6gv2s\" (UID: \"3f0275c3-34a2-49dd-86e1-1f90c3139a98\") " pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:27:44.143772 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.143762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c20e1114-ba31-4b6c-b2e8-9e2f5ec04904-metrics-certs\") pod \"network-metrics-daemon-jb6g4\" (UID: \"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904\") " pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:27:44.191083 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.191036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gv2s"
Jul 24 14:27:44.231390 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.231346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:27:44.234321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.234299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 14:27:44.244644 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.244619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 14:27:44.255770 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.255737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l2pk\" (UniqueName: \"kubernetes.io/projected/6426fe20-f508-4950-851b-14645d156969-kube-api-access-9l2pk\") pod \"network-check-target-7rjwp\" (UID: \"6426fe20-f508-4950-851b-14645d156969\") " pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:27:44.266919 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.266890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:44.331724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.331677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gv2s"]
Jul 24 14:27:44.335015 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:27:44.334984    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0275c3_34a2_49dd_86e1_1f90c3139a98.slice/crio-6ff4f190b05ae890967420abbb4c8a3b632f875d5f4385e966f236e3034bee92 WatchSource:0}: Error finding container 6ff4f190b05ae890967420abbb4c8a3b632f875d5f4385e966f236e3034bee92: Status 404 returned error can't find the container with id 6ff4f190b05ae890967420abbb4c8a3b632f875d5f4385e966f236e3034bee92
Jul 24 14:27:44.336755 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.336738    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:27:44.369131 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.369097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:44.399434 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.399361    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xh5fm\""
Jul 24 14:27:44.404637 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.404610    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbcqt\""
Jul 24 14:27:44.406697 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.406681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:27:44.412091 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.412071    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb6g4"
Jul 24 14:27:44.549573 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.549528    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7rjwp"]
Jul 24 14:27:44.551996 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:27:44.551963    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6426fe20_f508_4950_851b_14645d156969.slice/crio-5e79e2d88887ea4e1f103e934303707c93b57db02718b91ab1bcf8f2595e92a3 WatchSource:0}: Error finding container 5e79e2d88887ea4e1f103e934303707c93b57db02718b91ab1bcf8f2595e92a3: Status 404 returned error can't find the container with id 5e79e2d88887ea4e1f103e934303707c93b57db02718b91ab1bcf8f2595e92a3
Jul 24 14:27:44.567859 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:44.567833    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jb6g4"]
Jul 24 14:27:44.570737 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:27:44.570712    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20e1114_ba31_4b6c_b2e8_9e2f5ec04904.slice/crio-417cefebc23817c5ba60bea5a94effc434054a04f942cbf13c6f6acd1376d60e WatchSource:0}: Error finding container 417cefebc23817c5ba60bea5a94effc434054a04f942cbf13c6f6acd1376d60e: Status 404 returned error can't find the container with id 417cefebc23817c5ba60bea5a94effc434054a04f942cbf13c6f6acd1376d60e
Jul 24 14:27:45.031058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:45.031020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7rjwp" event={"ID":"6426fe20-f508-4950-851b-14645d156969","Type":"ContainerStarted","Data":"5e79e2d88887ea4e1f103e934303707c93b57db02718b91ab1bcf8f2595e92a3"}
Jul 24 14:27:45.032736 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:45.032691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb6g4" event={"ID":"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904","Type":"ContainerStarted","Data":"417cefebc23817c5ba60bea5a94effc434054a04f942cbf13c6f6acd1376d60e"}
Jul 24 14:27:45.034004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:45.033965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gv2s" event={"ID":"3f0275c3-34a2-49dd-86e1-1f90c3139a98","Type":"ContainerStarted","Data":"6ff4f190b05ae890967420abbb4c8a3b632f875d5f4385e966f236e3034bee92"}
Jul 24 14:27:47.047548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:47.047500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb6g4" event={"ID":"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904","Type":"ContainerStarted","Data":"3dbc6a32e90879353d5ad8792d0ffce9c722c0aa923386e8646ba194cdc9a595"}
Jul 24 14:27:47.048069 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:47.047630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb6g4" event={"ID":"c20e1114-ba31-4b6c-b2e8-9e2f5ec04904","Type":"ContainerStarted","Data":"45991e40ccd347cd20e7601d4877a4c35c26b4eff8f3c60fede4fcdd222d80ea"}
Jul 24 14:27:47.074932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:47.074849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jb6g4" podStartSLOduration=162.468751802 podStartE2EDuration="2m44.074829368s" totalImagesPullingTime="1.606077566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:47.074719668 +0000 UTC m=+331.462739785" watchObservedRunningTime="2026-07-24 14:27:47.074829368 +0000 UTC m=+331.462849485"
Jul 24 14:27:47.210288 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:47.210251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:47.282580 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:47.282523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:27:50.064919 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:50.064876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gv2s" event={"ID":"3f0275c3-34a2-49dd-86e1-1f90c3139a98","Type":"ContainerStarted","Data":"2fbfee9be57967e260992d0c45963744adf3004e3e5be48586d1f3adf1c654a1"}
Jul 24 14:27:50.066820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:50.066785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7rjwp" event={"ID":"6426fe20-f508-4950-851b-14645d156969","Type":"ContainerStarted","Data":"2620a368207108c1d8e811405274d39ca6da5460b634047c382fa4be66c163a9"}
Jul 24 14:27:50.066966 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:50.066934    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:27:50.088500 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:50.088437    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gv2s" podStartSLOduration=162.106244166 podStartE2EDuration="2m47.088412764s" totalImagesPullingTime="4.982168598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:50.08588244 +0000 UTC m=+334.473902557" watchObservedRunningTime="2026-07-24 14:27:50.088412764 +0000 UTC m=+334.476432880"
Jul 24 14:27:50.111134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:27:50.111077    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7rjwp" podStartSLOduration=162.353106234 podStartE2EDuration="2m47.111060096s" totalImagesPullingTime="4.757953862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:27:50.110750394 +0000 UTC m=+334.498770511" watchObservedRunningTime="2026-07-24 14:27:50.111060096 +0000 UTC m=+334.499080538"
Jul 24 14:28:03.676404 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:03.676352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:03.698028 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:03.697996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:04.141184 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:04.141152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:13.131496 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:13.131441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:13.317881 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:13.317845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:17.513657 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.513624    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:17.514117 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.513953    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="alertmanager" containerID="cri-o://0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630" gracePeriod=120
Jul 24 14:28:17.514117 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.513984    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-web" containerID="cri-o://919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7" gracePeriod=120
Jul 24 14:28:17.514117 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.513964    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy" containerID="cri-o://52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027" gracePeriod=120
Jul 24 14:28:17.514117 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.514012    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="prom-label-proxy" containerID="cri-o://736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e" gracePeriod=120
Jul 24 14:28:17.514117 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.514060    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="config-reloader" containerID="cri-o://6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f" gracePeriod=120
Jul 24 14:28:17.514385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:17.514020    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-metric" containerID="cri-o://98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec" gracePeriod=120
Jul 24 14:28:18.186233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.186197    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e" exitCode=0
Jul 24 14:28:18.186233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.186225    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec" exitCode=0
Jul 24 14:28:18.186233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.186233    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027" exitCode=0
Jul 24 14:28:18.186233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.186240    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f" exitCode=0
Jul 24 14:28:18.186233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.186245    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630" exitCode=0
Jul 24 14:28:18.187835 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.187806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"}
Jul 24 14:28:18.187968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.187867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"}
Jul 24 14:28:18.187968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.187893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"}
Jul 24 14:28:18.187968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.187917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"}
Jul 24 14:28:18.187968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.187940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"}
Jul 24 14:28:18.798162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.798131    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:18.845514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.845740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845532    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.845740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.845740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq25g\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.845740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845675    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.845740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.845700    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846456    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846490    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846584    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.846851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.846640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume\") pod \"ef788566-1822-41ce-aea9-5bb4999a629d\" (UID: \"ef788566-1822-41ce-aea9-5bb4999a629d\") "
Jul 24 14:28:18.848263 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.847759    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:18.848263 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.848202    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:18.848460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.848322    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:18.849532 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.849502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.852172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.852172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852136    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:18.852412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.852412 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.852596 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852576    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume" (OuterVolumeSpecName: "config-volume") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.852674 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g" (OuterVolumeSpecName: "kube-api-access-rq25g") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "kube-api-access-rq25g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:18.852926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.852906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out" (OuterVolumeSpecName: "config-out") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:18.856105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.856077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.865127 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.865093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config" (OuterVolumeSpecName: "web-config") pod "ef788566-1822-41ce-aea9-5bb4999a629d" (UID: "ef788566-1822-41ce-aea9-5bb4999a629d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:18.947351 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947310    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq25g\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-kube-api-access-rq25g\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947351 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947343    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef788566-1822-41ce-aea9-5bb4999a629d-tls-assets\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947351 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947356    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947370    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-main-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947383    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947395    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-config-out\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947408    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-metrics-client-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947418    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947430    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef788566-1822-41ce-aea9-5bb4999a629d-alertmanager-main-db\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947440    2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947450    2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-cluster-tls-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947488    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-web-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:18.947666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:18.947503    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef788566-1822-41ce-aea9-5bb4999a629d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:19.193970 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.193878    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef788566-1822-41ce-aea9-5bb4999a629d" containerID="919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7" exitCode=0
Jul 24 14:28:19.193970 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.193913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"}
Jul 24 14:28:19.193970 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.193956    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.194189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.193997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef788566-1822-41ce-aea9-5bb4999a629d","Type":"ContainerDied","Data":"4b825c5ef73d37b72e1b94b4d29979f05144a906780f83ac5a001c5e837a0b24"}
Jul 24 14:28:19.194189 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.194032    2560 scope.go:117] "RemoveContainer" containerID="736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"
Jul 24 14:28:19.202266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.202249    2560 scope.go:117] "RemoveContainer" containerID="98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"
Jul 24 14:28:19.209622 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.209604    2560 scope.go:117] "RemoveContainer" containerID="52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"
Jul 24 14:28:19.217043 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.217021    2560 scope.go:117] "RemoveContainer" containerID="919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"
Jul 24 14:28:19.221225 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.221195    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:19.224041 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.224011    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:19.226590 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.226573    2560 scope.go:117] "RemoveContainer" containerID="6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"
Jul 24 14:28:19.234379 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.234354    2560 scope.go:117] "RemoveContainer" containerID="0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"
Jul 24 14:28:19.242245 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.242225    2560 scope.go:117] "RemoveContainer" containerID="7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000"
Jul 24 14:28:19.250074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.250044    2560 scope.go:117] "RemoveContainer" containerID="736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"
Jul 24 14:28:19.250457 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.250424    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e\": container with ID starting with 736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e not found: ID does not exist" containerID="736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"
Jul 24 14:28:19.250594 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.250473    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e"} err="failed to get container status \"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e\": rpc error: code = NotFound desc = could not find container \"736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e\": container with ID starting with 736f8c6238e1f30e576203fc2be3179e79b1a60c35811eced4f4c19098ab9e6e not found: ID does not exist"
Jul 24 14:28:19.250594 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.250499    2560 scope.go:117] "RemoveContainer" containerID="98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"
Jul 24 14:28:19.250866 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.250845    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec\": container with ID starting with 98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec not found: ID does not exist" containerID="98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"
Jul 24 14:28:19.250965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.250869    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec"} err="failed to get container status \"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec\": rpc error: code = NotFound desc = could not find container \"98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec\": container with ID starting with 98c7c2ea7759f35c5ceab89f9a391ad9655551dbff2d5e1b12eed6d77a614fec not found: ID does not exist"
Jul 24 14:28:19.250965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.250887    2560 scope.go:117] "RemoveContainer" containerID="52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"
Jul 24 14:28:19.251140 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.251123    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027\": container with ID starting with 52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027 not found: ID does not exist" containerID="52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"
Jul 24 14:28:19.251180 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251149    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027"} err="failed to get container status \"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027\": rpc error: code = NotFound desc = could not find container \"52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027\": container with ID starting with 52e866af5eba5b536ab73c952f838113819de7402eb3f2bf40cf1c99f921d027 not found: ID does not exist"
Jul 24 14:28:19.251180 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251166    2560 scope.go:117] "RemoveContainer" containerID="919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"
Jul 24 14:28:19.251403 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.251388    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7\": container with ID starting with 919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7 not found: ID does not exist" containerID="919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"
Jul 24 14:28:19.251440 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251407    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7"} err="failed to get container status \"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7\": rpc error: code = NotFound desc = could not find container \"919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7\": container with ID starting with 919547d8134e70eefdea7a70652e20834dba4272c16308618bf30aed5e1680d7 not found: ID does not exist"
Jul 24 14:28:19.251440 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251420    2560 scope.go:117] "RemoveContainer" containerID="6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"
Jul 24 14:28:19.251686 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.251670    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f\": container with ID starting with 6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f not found: ID does not exist" containerID="6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"
Jul 24 14:28:19.251752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251690    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f"} err="failed to get container status \"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f\": rpc error: code = NotFound desc = could not find container \"6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f\": container with ID starting with 6e6dffa1fd84f0fd4bf50ce9ee50689997037ac39f8dc0dd1b1939ed364c851f not found: ID does not exist"
Jul 24 14:28:19.251752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251711    2560 scope.go:117] "RemoveContainer" containerID="0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"
Jul 24 14:28:19.251994 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.251977    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630\": container with ID starting with 0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630 not found: ID does not exist" containerID="0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"
Jul 24 14:28:19.252034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.251999    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630"} err="failed to get container status \"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630\": rpc error: code = NotFound desc = could not find container \"0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630\": container with ID starting with 0642bd7d0bc5d5191ac99a7506e05ea63d6405d52ce93013e2de163b56bc9630 not found: ID does not exist"
Jul 24 14:28:19.252034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.252014    2560 scope.go:117] "RemoveContainer" containerID="7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000"
Jul 24 14:28:19.252236 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:19.252218    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000\": container with ID starting with 7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000 not found: ID does not exist" containerID="7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000"
Jul 24 14:28:19.252275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.252242    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000"} err="failed to get container status \"7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000\": rpc error: code = NotFound desc = could not find container \"7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000\": container with ID starting with 7bdb678fc638f1889c6c5a7a92efbadc1f182e9c7df60d90e6d9c31d83507000 not found: ID does not exist"
Jul 24 14:28:19.262007 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.261979    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:19.262275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262264    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="init-config-reloader"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262277    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="init-config-reloader"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262292    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262297    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262306    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="config-reloader"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262311    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="config-reloader"
Jul 24 14:28:19.262317 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262317    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="prom-label-proxy"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262322    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="prom-label-proxy"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262328    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-metric"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262333    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-metric"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262349    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="alertmanager"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262353    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="alertmanager"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262360    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-web"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262365    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-web"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262404    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="config-reloader"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262413    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="prom-label-proxy"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262421    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="alertmanager"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262427    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-metric"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262432    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy-web"
Jul 24 14:28:19.262492 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.262437    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" containerName="kube-rbac-proxy"
Jul 24 14:28:19.265917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.265899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.268791 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.268768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 14:28:19.269272 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 14:28:19.269272 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 14:28:19.269436 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 14:28:19.269673 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269656    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 14:28:19.269741 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269684    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rwh77\""
Jul 24 14:28:19.269741 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 14:28:19.269741 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269659    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 14:28:19.269959 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.269944    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 14:28:19.277590 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.276252    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 14:28:19.284349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.284323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:19.351414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351414 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-web-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbp85\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-kube-api-access-dbp85\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-out\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.351771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.352074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.352074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.352074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.351832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-web-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbp85\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-kube-api-access-dbp85\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-out\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.452848 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.452712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.453542 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.453514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.454535 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.454509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.455832 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.455794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-web-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.455963 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.455941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-out\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456028 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.455941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456094 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.456074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456180 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.456155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6137a2ec-5b5b-4847-b1e4-386e9edec39f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456270 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.456188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456270 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.456257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-config-volume\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.456360 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.456332    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.457038 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.457023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.458039 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.458017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6137a2ec-5b5b-4847-b1e4-386e9edec39f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.463173 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.463154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbp85\" (UniqueName: \"kubernetes.io/projected/6137a2ec-5b5b-4847-b1e4-386e9edec39f-kube-api-access-dbp85\") pod \"alertmanager-main-0\" (UID: \"6137a2ec-5b5b-4847-b1e4-386e9edec39f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.580839 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.580799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 14:28:19.731987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:19.731825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 14:28:19.734290 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:28:19.734254    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6137a2ec_5b5b_4847_b1e4_386e9edec39f.slice/crio-7a83c9e8fe47bf7a2d126720630807277b575f03f7075a7921acbbe4ab621d56 WatchSource:0}: Error finding container 7a83c9e8fe47bf7a2d126720630807277b575f03f7075a7921acbbe4ab621d56: Status 404 returned error can't find the container with id 7a83c9e8fe47bf7a2d126720630807277b575f03f7075a7921acbbe4ab621d56
Jul 24 14:28:20.189465 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:20.189431    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef788566-1822-41ce-aea9-5bb4999a629d" path="/var/lib/kubelet/pods/ef788566-1822-41ce-aea9-5bb4999a629d/volumes"
Jul 24 14:28:20.198941 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:20.198904    2560 generic.go:356] "Generic (PLEG): container finished" podID="6137a2ec-5b5b-4847-b1e4-386e9edec39f" containerID="4c769eeb478f9e59a395a21657263d1730f12b4e4dcb36ed119fe9c9cffa904e" exitCode=0
Jul 24 14:28:20.199110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:20.198990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerDied","Data":"4c769eeb478f9e59a395a21657263d1730f12b4e4dcb36ed119fe9c9cffa904e"}
Jul 24 14:28:20.199110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:20.199083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"7a83c9e8fe47bf7a2d126720630807277b575f03f7075a7921acbbe4ab621d56"}
Jul 24 14:28:21.074488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.074461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7rjwp"
Jul 24 14:28:21.210795 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"129b446108414ce10ace7d6190425665733a2c26fc132ad3a57399332bdc9ade"}
Jul 24 14:28:21.211208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"8eeb8530a17f9917be6d974b9cd65c015b56e7dd7ea6920dce1c09d2022f63cc"}
Jul 24 14:28:21.211208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"0d043ee735439330666717f857ad7f248bc2d38e7d543c62b1ff51cd59fa9424"}
Jul 24 14:28:21.211208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"f5af899a97bffbad8c1d356549d98b375cb8196a6e7c046e963990afe5728c8b"}
Jul 24 14:28:21.211208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"fa620482018cd30849cc2a3c390888ac914f8482b976d6bc9ec9dcfcffe69e60"}
Jul 24 14:28:21.211208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.210927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6137a2ec-5b5b-4847-b1e4-386e9edec39f","Type":"ContainerStarted","Data":"f03b3af7f4e1bbfbbd058f7a5b01c6747f456809cec4320ab0babda2bcf5f263"}
Jul 24 14:28:21.241456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.241397    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.224756309 podStartE2EDuration="2.241381485s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.625176ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:28:21.23934456 +0000 UTC m=+365.627364690" watchObservedRunningTime="2026-07-24 14:28:21.241381485 +0000 UTC m=+365.629401630"
Jul 24 14:28:21.801096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801064    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:21.801386 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801356    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="prometheus" containerID="cri-o://5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc" gracePeriod=600
Jul 24 14:28:21.801464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801382    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="thanos-sidecar" containerID="cri-o://69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4" gracePeriod=600
Jul 24 14:28:21.801464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801402    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="config-reloader" containerID="cri-o://b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583" gracePeriod=600
Jul 24 14:28:21.801464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801439    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-web" containerID="cri-o://18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0" gracePeriod=600
Jul 24 14:28:21.801645 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801364    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy" containerID="cri-o://728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e" gracePeriod=600
Jul 24 14:28:21.801645 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:21.801391    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990" gracePeriod=600
Jul 24 14:28:22.065372 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.065343    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.179295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179365    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179398    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179424    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179446    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.179907 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.179878    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.180316 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180285    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.180431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrmxc\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180395    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180421    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180482    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180604    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180679 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180978 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.180978 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.180729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle\") pod \"e779a065-769f-485e-b7ca-543220525880\" (UID: \"e779a065-769f-485e-b7ca-543220525880\") "
Jul 24 14:28:22.181074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.181020    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.181074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.181039    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-metrics-client-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.181676 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.181398    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.182468 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.182170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.182468 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.182285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.182820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.182777    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.183292 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.183245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.184493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.184204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.184493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.184218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:22.184493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.184240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out" (OuterVolumeSpecName: "config-out") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.185077 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185047    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.185077 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc" (OuterVolumeSpecName: "kube-api-access-mrmxc") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "kube-api-access-mrmxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:22.185222 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.185275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185250    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.185470 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185444    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:22.185606 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.185949 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.185928    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.186398 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.186380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config" (OuterVolumeSpecName: "config") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.187049 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.187028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.195129 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.195104    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config" (OuterVolumeSpecName: "web-config") pod "e779a065-769f-485e-b7ca-543220525880" (UID: "e779a065-769f-485e-b7ca-543220525880"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.218686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218650    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990" exitCode=0
Jul 24 14:28:22.218686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218679    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e" exitCode=0
Jul 24 14:28:22.218686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218685    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0" exitCode=0
Jul 24 14:28:22.218686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218692    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4" exitCode=0
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218698    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583" exitCode=0
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218703    2560 generic.go:356] "Generic (PLEG): container finished" podID="e779a065-769f-485e-b7ca-543220525880" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc" exitCode=0
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218724    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218836    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.218978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"}
Jul 24 14:28:22.219187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.219004    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e779a065-769f-485e-b7ca-543220525880","Type":"ContainerDied","Data":"bd7bcfc86029718493d4a668b559dd3292d6e767c61bf70ce1b3972c77fe36bf"}
Jul 24 14:28:22.227290 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.227272    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.234704 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.234681    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.242040 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.242019    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.249475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.249448    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:22.250643 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.250571    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.255851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.255826    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:22.258475 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.258457    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.266366 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.266349    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.273634 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.273613    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.273927 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.273904    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.273979 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.273937    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.273979 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.273957    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.274201 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.274183    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.274234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274208    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.274234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274225    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.274482 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.274466    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.274525 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274486    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.274525 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274501    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.274789 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.274770    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.274868 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274797    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.274868 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.274817    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.275070 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.275053    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.275110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275075    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.275110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275091    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.275348 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.275331    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.275442 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275348    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.275442 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275361    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.275911 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:28:22.275895    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.275955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275915    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.275955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.275927    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.276158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276142    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.276204 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276159    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.276354 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276339    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.276354 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276354    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.276551 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276534    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.276551 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276551    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.276798 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276776    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.276849 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.276800    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.277030 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277012    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.277081 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277029    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.277238 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277223    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.277277 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277241    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.277437 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277422    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.277482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277439    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.277709 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277693    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.277709 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277708    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.277867 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277852    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.277914 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.277867    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.278101 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278084    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.278144 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278103    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.278329 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278308    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.278368 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278331    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.278605 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278587    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.278670 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278606    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.278855 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278838    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.278896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.278856    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.279060 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279042    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.279060 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279059    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.279282 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279267    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.279327 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279282    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.279499 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279484    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.279548 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279499    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.279785 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279765    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.279863 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279786    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.279964 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279946    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.280007 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.279967    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.280151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280133    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.280151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280150    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.280366 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280350    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.280407 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280366    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.280549 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280534    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.280620 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280548    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.280822 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280804    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.280881 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.280823    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.281054 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281036    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.281115 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281054    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.281278 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281261    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.281327 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281280    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.281512 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281487    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.281512 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281511    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.281725 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281706    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281731    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrmxc\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-kube-api-access-mrmxc\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281748    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281806    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-kube-rbac-proxy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281830    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281848    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-db\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281864    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281877    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-grpc-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.281896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281892    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281908    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281924    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281939    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e779a065-769f-485e-b7ca-543220525880-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281955    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-web-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281971    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e779a065-769f-485e-b7ca-543220525880-config-out\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281983    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.281997    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282011    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e779a065-769f-485e-b7ca-543220525880-secret-metrics-client-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282023    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e779a065-769f-485e-b7ca-543220525880-tls-assets\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.282461 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282340    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.282461 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282357    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.282603 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282585    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.282655 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282604    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.282836 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282815    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.282879 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.282837    2560 scope.go:117] "RemoveContainer" containerID="ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"
Jul 24 14:28:22.283092 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283075    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990"} err="failed to get container status \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": rpc error: code = NotFound desc = could not find container \"ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990\": container with ID starting with ab86dc2ad91ed0f7b0ba42cb87ed9a6d149661b5442b97a95df26ccc58b09990 not found: ID does not exist"
Jul 24 14:28:22.283129 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283093    2560 scope.go:117] "RemoveContainer" containerID="728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"
Jul 24 14:28:22.283332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283313    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e"} err="failed to get container status \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": rpc error: code = NotFound desc = could not find container \"728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e\": container with ID starting with 728989e778916aca9b5d6ff3b0f20444fe80630701ce210a02947720d213334e not found: ID does not exist"
Jul 24 14:28:22.283388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283332    2560 scope.go:117] "RemoveContainer" containerID="18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"
Jul 24 14:28:22.283616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283599    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0"} err="failed to get container status \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": rpc error: code = NotFound desc = could not find container \"18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0\": container with ID starting with 18d81b6e2cb7fc2c55f85f843c5c3039329ed43a9d03472e4dd384f5af40eef0 not found: ID does not exist"
Jul 24 14:28:22.283685 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283617    2560 scope.go:117] "RemoveContainer" containerID="69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"
Jul 24 14:28:22.283837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283821    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4"} err="failed to get container status \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": rpc error: code = NotFound desc = could not find container \"69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4\": container with ID starting with 69afa4c157e4883039b6ed8855b40922ac76f4d1d526b7c9c925e3bad54a71b4 not found: ID does not exist"
Jul 24 14:28:22.283882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.283837    2560 scope.go:117] "RemoveContainer" containerID="b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"
Jul 24 14:28:22.284060 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.284042    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583"} err="failed to get container status \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": rpc error: code = NotFound desc = could not find container \"b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583\": container with ID starting with b75600bdaeb9868ea3f147b1045ff535f85d09cd055cffe4a4a2274d06248583 not found: ID does not exist"
Jul 24 14:28:22.284105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.284061    2560 scope.go:117] "RemoveContainer" containerID="5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"
Jul 24 14:28:22.284284 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.284269    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc"} err="failed to get container status \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": rpc error: code = NotFound desc = could not find container \"5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc\": container with ID starting with 5148008e948856ee6d0e8adb6c2f1696cb4757bee0950f592d8a98016c42fbbc not found: ID does not exist"
Jul 24 14:28:22.284354 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.284284    2560 scope.go:117] "RemoveContainer" containerID="a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"
Jul 24 14:28:22.284469 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.284453    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663"} err="failed to get container status \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": rpc error: code = NotFound desc = could not find container \"a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663\": container with ID starting with a85a22d3d7ba5ffb28a18e49984f81b4153f8548839f94e104177f3c6dca4663 not found: ID does not exist"
Jul 24 14:28:22.309376 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309299    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:22.309613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309601    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="prometheus"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309615    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="prometheus"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309630    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="thanos-sidecar"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309636    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="thanos-sidecar"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309644    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-thanos"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309649    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-thanos"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309657    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="init-config-reloader"
Jul 24 14:28:22.309664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309663    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="init-config-reloader"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309671    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="config-reloader"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309677    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="config-reloader"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309685    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309690    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309700    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-web"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309706    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-web"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309750    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-thanos"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309757    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="config-reloader"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309763    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="prometheus"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309768    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="thanos-sidecar"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309773    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy"
Jul 24 14:28:22.309869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.309780    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e779a065-769f-485e-b7ca-543220525880" containerName="kube-rbac-proxy-web"
Jul 24 14:28:22.313704 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.313683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.317680 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.317655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 14:28:22.317829 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.317730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 14:28:22.317893 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.317834    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 14:28:22.317987 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.317974    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-20i42a3ok6t0j\""
Jul 24 14:28:22.320891 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.320719    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 14:28:22.338534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.337868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 14:28:22.338534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.338333    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 14:28:22.338534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.338391    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 14:28:22.339254 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.338738    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 14:28:22.339254 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.338835    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 14:28:22.340988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.340244    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 14:28:22.340988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.340437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kptwd\""
Jul 24 14:28:22.340988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.340623    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 14:28:22.340988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.340791    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 14:28:22.345834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.345801    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 14:28:22.353906 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.353876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:22.365797 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.365770    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 14:28:22.382754 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-web-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.382911 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.382911 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.382911 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.382911 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-config-out\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.382911 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383064 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383064 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383064 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.382966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383064 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383174 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383174 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383174 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262pr\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-kube-api-access-262pr\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383174 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383421 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.383421 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.383352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.484777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.484740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.484777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.484784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.484807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.484831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.484995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262pr\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-kube-api-access-262pr\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485110 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485396 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485396 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-web-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-config-out\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.485752 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.485738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.486275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.486052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.486275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.486223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.486275 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.486264    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.487638 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.487610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.488482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.488434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.489233 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.489207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c29eeb34-15e5-4c22-b055-65293a826569-config-out\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.489431 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.489375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.489692 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.489652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.490079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.489779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.490079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.490014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.490079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.490034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.490838 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.490819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-web-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.490952 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.490934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.491309 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.491294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.491381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.491360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c29eeb34-15e5-4c22-b055-65293a826569-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.491433 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.491398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c29eeb34-15e5-4c22-b055-65293a826569-config\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.499371 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.497691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-262pr\" (UniqueName: \"kubernetes.io/projected/c29eeb34-15e5-4c22-b055-65293a826569-kube-api-access-262pr\") pod \"prometheus-k8s-0\" (UID: \"c29eeb34-15e5-4c22-b055-65293a826569\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.647996 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.647960    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:22.798701 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:22.798676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 14:28:22.801216 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:28:22.801188    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29eeb34_15e5_4c22_b055_65293a826569.slice/crio-591f8fc7cb1668e2d7f0a5dec29390562d8aa0fd94d44a594f68628f5671e286 WatchSource:0}: Error finding container 591f8fc7cb1668e2d7f0a5dec29390562d8aa0fd94d44a594f68628f5671e286: Status 404 returned error can't find the container with id 591f8fc7cb1668e2d7f0a5dec29390562d8aa0fd94d44a594f68628f5671e286
Jul 24 14:28:23.224948 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:23.224854    2560 generic.go:356] "Generic (PLEG): container finished" podID="c29eeb34-15e5-4c22-b055-65293a826569" containerID="2a14073aadd02c71c8cd485d8e06ff254e8f96975cae4fca8f846535a1776a7a" exitCode=0
Jul 24 14:28:23.224948 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:23.224902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerDied","Data":"2a14073aadd02c71c8cd485d8e06ff254e8f96975cae4fca8f846535a1776a7a"}
Jul 24 14:28:23.225356 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:23.224953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"591f8fc7cb1668e2d7f0a5dec29390562d8aa0fd94d44a594f68628f5671e286"}
Jul 24 14:28:24.188955 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.188911    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e779a065-769f-485e-b7ca-543220525880" path="/var/lib/kubelet/pods/e779a065-769f-485e-b7ca-543220525880/volumes"
Jul 24 14:28:24.232783 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"b69dbfe06bfeb1fcfe3c689fc30fe0765364bf3035b69604b4725925bf3bc935"}
Jul 24 14:28:24.233224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"3fcad1fa5719d246fb220e217ffa60ca67a46455768003ac9f8cdeb362718308"}
Jul 24 14:28:24.233224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"e35f61f109ee9bc3454ead0598a59156da906393eba2205465ef132520149c59"}
Jul 24 14:28:24.233224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"72cda4d633fb0ec467e5e10749ecd728e866b2972cb55115272b4fe8f9c57306"}
Jul 24 14:28:24.233224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"8eeabfae2e3d6c721c4158357add000c2e3374bd2203f0cb1996856e185340e1"}
Jul 24 14:28:24.233224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.232916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c29eeb34-15e5-4c22-b055-65293a826569","Type":"ContainerStarted","Data":"45332ea3c1521e9e6e89dafe372880abdcdd86a34018a0549b9a9c0f4cb67d2d"}
Jul 24 14:28:24.269713 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:24.269652    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.249066612 podStartE2EDuration="2.269635136s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.568524ms" isStatefulPod=false podCreationTimestamp="2026-07-24 14:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:28:24.267683674 +0000 UTC m=+368.655703792" watchObservedRunningTime="2026-07-24 14:28:24.269635136 +0000 UTC m=+368.657655252"
Jul 24 14:28:25.035148 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:25.035114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:25.128006 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:25.127973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:27.649039 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:27.649003    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:28:28.146321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:28.146286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:28.255540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:28.255504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:30.601873 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:30.601825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:30.705309 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:30.705270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:31.005867 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:31.005786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:39.423158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:39.423124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:39.522543 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:39.522510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:28:39.616910 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:28:39.616874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:05.750533 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:05.750497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:05.851307 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:05.851272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:21.563645 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:21.563604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:21.659240 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:21.659203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:22.648628 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:22.648590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:29:22.665841 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:22.665813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:29:23.490005 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:23.489969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 14:29:38.380207 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:38.380120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:38.480762 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:38.480730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:43.305865 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:43.305829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:44.312514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:44.312464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:46.889511 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:46.889475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:46.990281 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:46.990245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:48.214659 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:48.214622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:48.311171 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:48.311130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:48.838921 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:48.838891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:49.002659 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:49.002624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:50.449494 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:50.449459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:50.849141 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:50.849102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:53.899690 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:53.899650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:53.983830 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:53.983794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:29:58.868843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:29:58.868801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:01.066301 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:01.066260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:01.269107 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:01.269066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:02.487768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.487733    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"]
Jul 24 14:30:02.491018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.491001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.496755 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.496727    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 14:30:02.497687 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.497593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5xjzf\""
Jul 24 14:30:02.497687 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.497634    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 14:30:02.522862 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.522830    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"]
Jul 24 14:30:02.569340 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.569296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895wx\" (UniqueName: \"kubernetes.io/projected/ce627206-a0f6-4ef3-be7c-1eb37651f187-kube-api-access-895wx\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.569522 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.569355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce627206-a0f6-4ef3-be7c-1eb37651f187-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.670818 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.670791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-895wx\" (UniqueName: \"kubernetes.io/projected/ce627206-a0f6-4ef3-be7c-1eb37651f187-kube-api-access-895wx\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.670997 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.670837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce627206-a0f6-4ef3-be7c-1eb37651f187-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.671200 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.671184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce627206-a0f6-4ef3-be7c-1eb37651f187-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.685881 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.685845    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-895wx\" (UniqueName: \"kubernetes.io/projected/ce627206-a0f6-4ef3-be7c-1eb37651f187-kube-api-access-895wx\") pod \"openshift-lws-operator-fd8ccff4c-cpk2s\" (UID: \"ce627206-a0f6-4ef3-be7c-1eb37651f187\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.809434 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.809336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"
Jul 24 14:30:02.955581 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:02.955525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s"]
Jul 24 14:30:02.958846 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:30:02.958817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce627206_a0f6_4ef3_be7c_1eb37651f187.slice/crio-355f0d9003154204827ce3c938004e0fe19daf4eb6f506e9b0c2728b358410b0 WatchSource:0}: Error finding container 355f0d9003154204827ce3c938004e0fe19daf4eb6f506e9b0c2728b358410b0: Status 404 returned error can't find the container with id 355f0d9003154204827ce3c938004e0fe19daf4eb6f506e9b0c2728b358410b0
Jul 24 14:30:03.627946 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:03.627912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s" event={"ID":"ce627206-a0f6-4ef3-be7c-1eb37651f187","Type":"ContainerStarted","Data":"355f0d9003154204827ce3c938004e0fe19daf4eb6f506e9b0c2728b358410b0"}
Jul 24 14:30:08.651015 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:08.650979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s" event={"ID":"ce627206-a0f6-4ef3-be7c-1eb37651f187","Type":"ContainerStarted","Data":"f1be2eb8586f9a5b36299ec252e98842e3ae9f669d88e6ef967bd500b5cc0f27"}
Jul 24 14:30:08.670336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:08.670279    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpk2s" podStartSLOduration=1.724134705 podStartE2EDuration="6.670262986s" totalImagesPullingTime="4.946128281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:08.669503544 +0000 UTC m=+473.057523659" watchObservedRunningTime="2026-07-24 14:30:08.670262986 +0000 UTC m=+473.058283102"
Jul 24 14:30:09.649272 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:09.649238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:09.910349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:09.910251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:11.541483 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:11.541445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:13.239120 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:13.239078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:13.362765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:13.362734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:23.879813 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:23.879774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:23.975227 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:23.975180    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"]
Jul 24 14:30:23.978664 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:23.978645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:23.988132 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:23.988105    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret"
Jul 24 14:30:23.988239 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:23.988105    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-6r75f\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6r75f\"" type="*v1.Secret"
Jul 24 14:30:23.990439 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:23.990412    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret"
Jul 24 14:30:23.995657 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:23.995640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 14:30:24.021506 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.021474    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"]
Jul 24 14:30:24.072426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.072385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.072640 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.072435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.072640 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.072523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1f93aa3-9428-405d-8450-3fafdf028326-manager-config\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.072640 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.072633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6fnx\" (UniqueName: \"kubernetes.io/projected/c1f93aa3-9428-405d-8450-3fafdf028326-kube-api-access-b6fnx\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.072843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.072818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:24.173213 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.173122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.173213 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.173162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.173213 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.173183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1f93aa3-9428-405d-8450-3fafdf028326-manager-config\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.173458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.173285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6fnx\" (UniqueName: \"kubernetes.io/projected/c1f93aa3-9428-405d-8450-3fafdf028326-kube-api-access-b6fnx\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.173880 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.173860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c1f93aa3-9428-405d-8450-3fafdf028326-manager-config\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:24.185621 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:24.185595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6fnx\" (UniqueName: \"kubernetes.io/projected/c1f93aa3-9428-405d-8450-3fafdf028326-kube-api-access-b6fnx\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.174364 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:25.174330    2560 secret.go:189] Couldn't get secret openshift-lws-operator/metrics-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 24 14:30:25.174805 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:25.174416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert podName:c1f93aa3-9428-405d-8450-3fafdf028326 nodeName:}" failed. No retries permitted until 2026-07-24 14:30:25.674395183 +0000 UTC m=+490.062415281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert") pod "lws-controller-manager-76765b76bd-lz279" (UID: "c1f93aa3-9428-405d-8450-3fafdf028326") : failed to sync secret cache: timed out waiting for the condition
Jul 24 14:30:25.174805 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:25.174339    2560 secret.go:189] Couldn't get secret openshift-lws-operator/webhook-server-cert: failed to sync secret cache: timed out waiting for the condition
Jul 24 14:30:25.174805 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:30:25.174492    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert podName:c1f93aa3-9428-405d-8450-3fafdf028326 nodeName:}" failed. No retries permitted until 2026-07-24 14:30:25.674476079 +0000 UTC m=+490.062496176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert") pod "lws-controller-manager-76765b76bd-lz279" (UID: "c1f93aa3-9428-405d-8450-3fafdf028326") : failed to sync secret cache: timed out waiting for the condition
Jul 24 14:30:25.338584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.338525    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 14:30:25.415472 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.415440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 14:30:25.528970 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.528877    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6r75f\""
Jul 24 14:30:25.687083 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.687047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.687267 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.687091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.689860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.689824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.689860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.689848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c1f93aa3-9428-405d-8450-3fafdf028326-metrics-cert\") pod \"lws-controller-manager-76765b76bd-lz279\" (UID: \"c1f93aa3-9428-405d-8450-3fafdf028326\") " pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.787420 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.787318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:25.932218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:25.932187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"]
Jul 24 14:30:25.935690 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:30:25.935658    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f93aa3_9428_405d_8450_3fafdf028326.slice/crio-8bbf2996aef886713ccc27315101a72bc0c389b13faf676362fb0480aea77f95 WatchSource:0}: Error finding container 8bbf2996aef886713ccc27315101a72bc0c389b13faf676362fb0480aea77f95: Status 404 returned error can't find the container with id 8bbf2996aef886713ccc27315101a72bc0c389b13faf676362fb0480aea77f95
Jul 24 14:30:26.061400 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:26.061304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:26.158802 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:26.158747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:26.567896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:26.567862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:26.723523 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:26.723487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279" event={"ID":"c1f93aa3-9428-405d-8450-3fafdf028326","Type":"ContainerStarted","Data":"8bbf2996aef886713ccc27315101a72bc0c389b13faf676362fb0480aea77f95"}
Jul 24 14:30:27.185445 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.185398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.285610 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.285544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.333657 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.333622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"]
Jul 24 14:30:27.338488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.338467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.343385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.343335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 14:30:27.343385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.343381    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k4dnd\""
Jul 24 14:30:27.343635 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.343404    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 14:30:27.343727 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.343712    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 14:30:27.343863 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.343848    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 14:30:27.352333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.352308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"]
Jul 24 14:30:27.399817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.399771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.400004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.399848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdtd\" (UniqueName: \"kubernetes.io/projected/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-kube-api-access-xtdtd\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.400004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.399884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.400004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.399901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.400133 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.400045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.476858 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.476742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.500806 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.500772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdtd\" (UniqueName: \"kubernetes.io/projected/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-kube-api-access-xtdtd\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.500928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.500816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.500928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.500838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.500928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.500892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.500928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.500922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.501351 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.501327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-manifests\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.503501 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.503479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-tmp\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.503652 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.503635    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.503826 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.503805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.511639 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.511605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdtd\" (UniqueName: \"kubernetes.io/projected/c78ac5b3-58e4-48e0-8bab-53fafe5443b6-kube-api-access-xtdtd\") pod \"opendatahub-operator-controller-manager-64bbcbb69d-hfvqm\" (UID: \"c78ac5b3-58e4-48e0-8bab-53fafe5443b6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.636871 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.636830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.650288 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.650249    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:27.735970 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.734194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.801178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.801096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"]
Jul 24 14:30:27.804133 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:30:27.804103    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78ac5b3_58e4_48e0_8bab_53fafe5443b6.slice/crio-73ffaa49e4cffa830e5984429360fc062f5affeb7ce851e10739bf395ad369f6 WatchSource:0}: Error finding container 73ffaa49e4cffa830e5984429360fc062f5affeb7ce851e10739bf395ad369f6: Status 404 returned error can't find the container with id 73ffaa49e4cffa830e5984429360fc062f5affeb7ce851e10739bf395ad369f6
Jul 24 14:30:27.835817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.835775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:27.933994 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:27.933948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:28.485159 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:28.485036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:28.736211 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:28.736110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm" event={"ID":"c78ac5b3-58e4-48e0-8bab-53fafe5443b6","Type":"ContainerStarted","Data":"73ffaa49e4cffa830e5984429360fc062f5affeb7ce851e10739bf395ad369f6"}
Jul 24 14:30:29.743020 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:29.742984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279" event={"ID":"c1f93aa3-9428-405d-8450-3fafdf028326","Type":"ContainerStarted","Data":"c79d8d18c3aae5c1b19356385ee44627ba294c47324569ba1837aa153da90e85"}
Jul 24 14:30:29.743464 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:29.743103    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:29.773867 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:29.773794    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279" podStartSLOduration=3.840043591 podStartE2EDuration="6.773772143s" totalImagesPullingTime="2.933728552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:29.771043093 +0000 UTC m=+494.159063210" watchObservedRunningTime="2026-07-24 14:30:29.773772143 +0000 UTC m=+494.161792262"
Jul 24 14:30:31.753088 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:31.753046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm" event={"ID":"c78ac5b3-58e4-48e0-8bab-53fafe5443b6","Type":"ContainerStarted","Data":"1fce38d7932e0765723fa76c4d96d40a5d00b3b23ae051c8f41584d5368df562"}
Jul 24 14:30:32.759018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:32.758982    2560 generic.go:356] "Generic (PLEG): container finished" podID="c78ac5b3-58e4-48e0-8bab-53fafe5443b6" containerID="1fce38d7932e0765723fa76c4d96d40a5d00b3b23ae051c8f41584d5368df562" exitCode=0
Jul 24 14:30:32.759018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:32.759021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm" event={"ID":"c78ac5b3-58e4-48e0-8bab-53fafe5443b6","Type":"ContainerDied","Data":"1fce38d7932e0765723fa76c4d96d40a5d00b3b23ae051c8f41584d5368df562"}
Jul 24 14:30:33.765867 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:33.765826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm" event={"ID":"c78ac5b3-58e4-48e0-8bab-53fafe5443b6","Type":"ContainerStarted","Data":"6e1879aca64498555cf736ecbad5e71da27af337e04e3c910f472324acb415b6"}
Jul 24 14:30:33.766328 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:33.765949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:33.792653 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:33.792599    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm" podStartSLOduration=2.353395377 podStartE2EDuration="6.792581008s" totalImagesPullingTime="3.345876261s" totalInitContainerRuntime="1.09330937s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:33.792532814 +0000 UTC m=+498.180552942" watchObservedRunningTime="2026-07-24 14:30:33.792581008 +0000 UTC m=+498.180601115"
Jul 24 14:30:40.750020 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:40.749987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76765b76bd-lz279"
Jul 24 14:30:44.771930 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:44.771895    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64bbcbb69d-hfvqm"
Jul 24 14:30:46.738957 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:46.738921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:46.895944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:46.895912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:47.670301 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:47.670273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:47.773744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:47.773709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:47.874010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:47.873970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:48.394034 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:48.393984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:48.892937 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:48.892902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:57.991915 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:57.991877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:58.095457 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.095417    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"]
Jul 24 14:30:58.102872 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.102851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.105874 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.105852    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 14:30:58.106917 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.106890    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7kwwm\""
Jul 24 14:30:58.107124 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.106976    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 14:30:58.107201 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.107127    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 14:30:58.107201 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.107178    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 14:30:58.109051 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.109027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"]
Jul 24 14:30:58.191035 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.191001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569a6bb8-8794-4ccb-bee3-26e386db66da-tls-certs\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.191035 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.191038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/569a6bb8-8794-4ccb-bee3-26e386db66da-tmp\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.191257 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.191054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbd6t\" (UniqueName: \"kubernetes.io/projected/569a6bb8-8794-4ccb-bee3-26e386db66da-kube-api-access-wbd6t\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.292420 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.292317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569a6bb8-8794-4ccb-bee3-26e386db66da-tls-certs\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.292420 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.292372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/569a6bb8-8794-4ccb-bee3-26e386db66da-tmp\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.292420 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.292399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbd6t\" (UniqueName: \"kubernetes.io/projected/569a6bb8-8794-4ccb-bee3-26e386db66da-kube-api-access-wbd6t\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.294822 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.294790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/569a6bb8-8794-4ccb-bee3-26e386db66da-tmp\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.295011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.294994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/569a6bb8-8794-4ccb-bee3-26e386db66da-tls-certs\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.304127 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.304100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbd6t\" (UniqueName: \"kubernetes.io/projected/569a6bb8-8794-4ccb-bee3-26e386db66da-kube-api-access-wbd6t\") pod \"kube-auth-proxy-68b7bd974d-6wl78\" (UID: \"569a6bb8-8794-4ccb-bee3-26e386db66da\") " pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.304791 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.304769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:58.414324 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.414277    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"
Jul 24 14:30:58.564090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.564010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78"]
Jul 24 14:30:58.567246 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:30:58.567217    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569a6bb8_8794_4ccb_bee3_26e386db66da.slice/crio-acf13ab7c5c129061f9f463d16ad6011105b250eb3eff7739816074861fc7842 WatchSource:0}: Error finding container acf13ab7c5c129061f9f463d16ad6011105b250eb3eff7739816074861fc7842: Status 404 returned error can't find the container with id acf13ab7c5c129061f9f463d16ad6011105b250eb3eff7739816074861fc7842
Jul 24 14:30:58.881758 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:58.881727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78" event={"ID":"569a6bb8-8794-4ccb-bee3-26e386db66da","Type":"ContainerStarted","Data":"acf13ab7c5c129061f9f463d16ad6011105b250eb3eff7739816074861fc7842"}
Jul 24 14:30:59.454493 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:59.453977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:59.598046 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:59.598013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:30:59.798920 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:30:59.798822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:00.045227 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:00.045178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:00.581843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:00.581805    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:00.718629 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:00.718596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:00.960381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:00.960336    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:01.103332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:01.103287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:01.245478 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:01.245376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:01.903805 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:01.903720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78" event={"ID":"569a6bb8-8794-4ccb-bee3-26e386db66da","Type":"ContainerStarted","Data":"84fb975ca5e2e16d671c2ec3b9b2382f892db78c09f312ea2a07edc8210c9932"}
Jul 24 14:31:01.926938 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:01.926878    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68b7bd974d-6wl78" podStartSLOduration=0.894416332 podStartE2EDuration="3.926858736s" totalImagesPullingTime="3.032442404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:31:01.926846964 +0000 UTC m=+526.314867080" watchObservedRunningTime="2026-07-24 14:31:01.926858736 +0000 UTC m=+526.314878843"
Jul 24 14:31:02.756617 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:02.756550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:04.647712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:04.647678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:04.782783 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:04.782754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:06.231373 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:06.231337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:06.433458 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:06.433421    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:06.549386 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:06.549294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:30.777048 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:30.777013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:48.313476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:48.313439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:48.421364 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:48.421329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:48.538781 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:48.538746    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:53.078005 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:53.077943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:31:53.188421 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:31:53.188389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:16.981185 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:16.981140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:20.408745 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:20.408712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:22.365250 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:22.365223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:24.254729 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:24.254693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:24.432780 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:24.432747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:26.642681 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:26.642646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:26.771893 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:26.771852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:27.472793 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:27.472749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:27.581273 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:27.581240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:27.673503 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:27.673475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:27.783451 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:27.783367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:28.243396 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:28.243365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:28.335352 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:28.335321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:29.014080 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:29.014050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:30.051404 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.051374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"]
Jul 24 14:32:30.055191 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.055164    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"]
Jul 24 14:32:30.055328 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.055287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.057737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.057705    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 14:32:30.057737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.057706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wqjkb\""
Jul 24 14:32:30.057932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.057706    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 14:32:30.057932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.057704    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 14:32:30.058363 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.058346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:30.058669 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.058653    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 14:32:30.060569 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.060535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wpc7s\""
Jul 24 14:32:30.070870 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.070850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"]
Jul 24 14:32:30.089095 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.089058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"]
Jul 24 14:32:30.096890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.096852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:30.138156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.138114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbcsp\" (UniqueName: \"kubernetes.io/projected/706e1945-5bb8-4808-97f4-3310dc01230c-kube-api-access-mbcsp\") pod \"authorino-operator-75cc8d5cb7-w4qr6\" (UID: \"706e1945-5bb8-4808-97f4-3310dc01230c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:30.138156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.138157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dc8244f-0513-444c-bbf1-ccfa41558a48-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.138384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.138185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdnb\" (UniqueName: \"kubernetes.io/projected/6dc8244f-0513-444c-bbf1-ccfa41558a48-kube-api-access-6rdnb\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.138384 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.138240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.239441 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.239398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbcsp\" (UniqueName: \"kubernetes.io/projected/706e1945-5bb8-4808-97f4-3310dc01230c-kube-api-access-mbcsp\") pod \"authorino-operator-75cc8d5cb7-w4qr6\" (UID: \"706e1945-5bb8-4808-97f4-3310dc01230c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:30.239441 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.239438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dc8244f-0513-444c-bbf1-ccfa41558a48-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.239767 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.239460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdnb\" (UniqueName: \"kubernetes.io/projected/6dc8244f-0513-444c-bbf1-ccfa41558a48-kube-api-access-6rdnb\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.239767 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.239511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.239767 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:32:30.239682    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 24 14:32:30.239767 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:32:30.239767    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert podName:6dc8244f-0513-444c-bbf1-ccfa41558a48 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:30.739744506 +0000 UTC m=+615.127764807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2pxp2" (UID: "6dc8244f-0513-444c-bbf1-ccfa41558a48") : secret "plugin-serving-cert" not found
Jul 24 14:32:30.240195 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.240176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6dc8244f-0513-444c-bbf1-ccfa41558a48-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.258144 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.258110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdnb\" (UniqueName: \"kubernetes.io/projected/6dc8244f-0513-444c-bbf1-ccfa41558a48-kube-api-access-6rdnb\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.258362 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.258339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbcsp\" (UniqueName: \"kubernetes.io/projected/706e1945-5bb8-4808-97f4-3310dc01230c-kube-api-access-mbcsp\") pod \"authorino-operator-75cc8d5cb7-w4qr6\" (UID: \"706e1945-5bb8-4808-97f4-3310dc01230c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:30.331925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.331835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:30.373488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.373457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:30.518820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.518788    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"]
Jul 24 14:32:30.521816 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:32:30.521785    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706e1945_5bb8_4808_97f4_3310dc01230c.slice/crio-a1f8152aca2a6a8ea91e72f87d2a18941503a7cf63c0b165870f06f36850d50d WatchSource:0}: Error finding container a1f8152aca2a6a8ea91e72f87d2a18941503a7cf63c0b165870f06f36850d50d: Status 404 returned error can't find the container with id a1f8152aca2a6a8ea91e72f87d2a18941503a7cf63c0b165870f06f36850d50d
Jul 24 14:32:30.699634 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.699593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:30.743880 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.743841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.746388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.746369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dc8244f-0513-444c-bbf1-ccfa41558a48-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2pxp2\" (UID: \"6dc8244f-0513-444c-bbf1-ccfa41558a48\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:30.800581 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.800531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:30.966894 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:30.966801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"
Jul 24 14:32:31.106327 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:31.106302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2"]
Jul 24 14:32:31.109274 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:32:31.109243    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dc8244f_0513_444c_bbf1_ccfa41558a48.slice/crio-da250aade20f234698533c3759ffd32c9f46bf893997ee4852cd0d29bfc0c109 WatchSource:0}: Error finding container da250aade20f234698533c3759ffd32c9f46bf893997ee4852cd0d29bfc0c109: Status 404 returned error can't find the container with id da250aade20f234698533c3759ffd32c9f46bf893997ee4852cd0d29bfc0c109
Jul 24 14:32:31.318687 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:31.318593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2" event={"ID":"6dc8244f-0513-444c-bbf1-ccfa41558a48","Type":"ContainerStarted","Data":"da250aade20f234698533c3759ffd32c9f46bf893997ee4852cd0d29bfc0c109"}
Jul 24 14:32:31.320047 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:31.320016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6" event={"ID":"706e1945-5bb8-4808-97f4-3310dc01230c","Type":"ContainerStarted","Data":"a1f8152aca2a6a8ea91e72f87d2a18941503a7cf63c0b165870f06f36850d50d"}
Jul 24 14:32:31.984010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:31.983951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:32.083863 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:32.083830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:32.629446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:32.629406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:32.709942 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:32.709900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:33.332366 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:33.332243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6" event={"ID":"706e1945-5bb8-4808-97f4-3310dc01230c","Type":"ContainerStarted","Data":"3b09a4ccd60e48f5ec71871459ef3c5f832cb9cacf43d073c6e0a1d50b94b1b4"}
Jul 24 14:32:33.332366 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:33.332319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:33.351994 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:33.351930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6" podStartSLOduration=0.915875178 podStartE2EDuration="3.351907079s" totalImagesPullingTime="2.436031901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:33.350706205 +0000 UTC m=+617.738726322" watchObservedRunningTime="2026-07-24 14:32:33.351907079 +0000 UTC m=+617.739927196"
Jul 24 14:32:38.400136 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:38.400045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:38.505010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:38.504965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:38.576507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:38.576462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:39.725967 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:39.725915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:39.862313 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:39.862257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:44.341401 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:44.341369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-w4qr6"
Jul 24 14:32:44.405282 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:44.405250    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:44.504914 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:44.504860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:49.190838 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:49.190803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:49.290074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:49.290035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:51.836967 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:51.836869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:51.944336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:51.944295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:53.418569 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:53.418522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:32:53.448446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:53.448409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2" event={"ID":"6dc8244f-0513-444c-bbf1-ccfa41558a48","Type":"ContainerStarted","Data":"a7e11ec2df1703ade8fca6a8a5472e649a35dbbe05f9ebdb308fa5d7f64aec2c"}
Jul 24 14:32:53.474038 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:53.473976    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2pxp2" podStartSLOduration=1.706057025 podStartE2EDuration="23.473959986s" totalImagesPullingTime="21.767902961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:53.473601992 +0000 UTC m=+637.861622109" watchObservedRunningTime="2026-07-24 14:32:53.473959986 +0000 UTC m=+637.861980101"
Jul 24 14:32:53.518216 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:32:53.518180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:00.611251 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:00.611216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:00.708217 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:00.708186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:04.843531 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:04.843497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:04.942289 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:04.942243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:09.659292 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:09.659257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:09.751534 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:09.751495    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:09.847821 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:09.847784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:09.948720 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:09.948639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:12.409773 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:12.409676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:12.518295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:12.518263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:12.646403 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:12.646372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:13.417616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.417585    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:13.434975 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.434924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:13.435157 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.435049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:13.439701 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.439673    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j8td5\""
Jul 24 14:33:13.466297 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.466260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsr8b\" (UniqueName: \"kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b\") pod \"authorino-58cd955675-78qtv\" (UID: \"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198\") " pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:13.515178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.515137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:13.567430 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.567394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsr8b\" (UniqueName: \"kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b\") pod \"authorino-58cd955675-78qtv\" (UID: \"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198\") " pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:13.591624 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.591584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsr8b\" (UniqueName: \"kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b\") pod \"authorino-58cd955675-78qtv\" (UID: \"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198\") " pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:13.693036 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.692942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:13.744934 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.744893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:13.821387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.821358    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:13.830148 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.830119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:13.839335 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.839080    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:13.870807 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.870763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8ng\" (UniqueName: \"kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng\") pod \"authorino-75d556bd77-zn89v\" (UID: \"bc7a7a38-e8b4-4883-9bde-495d9ec557c5\") " pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:13.898121 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.898096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:13.900298 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:33:13.900271    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb681a61f_45c8_47b6_9cb8_d7ebd3eb0198.slice/crio-3e329ac6d7bd083a86178999cc37dbb9477d3fda6d3f2c8de5fb5b74d40ace83 WatchSource:0}: Error finding container 3e329ac6d7bd083a86178999cc37dbb9477d3fda6d3f2c8de5fb5b74d40ace83: Status 404 returned error can't find the container with id 3e329ac6d7bd083a86178999cc37dbb9477d3fda6d3f2c8de5fb5b74d40ace83
Jul 24 14:33:13.901883 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.901851    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:33:13.971335 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.971249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8ng\" (UniqueName: \"kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng\") pod \"authorino-75d556bd77-zn89v\" (UID: \"bc7a7a38-e8b4-4883-9bde-495d9ec557c5\") " pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:13.985002 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:13.984975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8ng\" (UniqueName: \"kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng\") pod \"authorino-75d556bd77-zn89v\" (UID: \"bc7a7a38-e8b4-4883-9bde-495d9ec557c5\") " pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:14.142951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:14.142912    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:14.286966 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:14.286940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:14.288524 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:33:14.288493    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc7a7a38_e8b4_4883_9bde_495d9ec557c5.slice/crio-956050cbd9878693090c0b8f707e28d048fdf3560d969fd1d26410febf1e366f WatchSource:0}: Error finding container 956050cbd9878693090c0b8f707e28d048fdf3560d969fd1d26410febf1e366f: Status 404 returned error can't find the container with id 956050cbd9878693090c0b8f707e28d048fdf3560d969fd1d26410febf1e366f
Jul 24 14:33:14.547977 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:14.547854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn89v" event={"ID":"bc7a7a38-e8b4-4883-9bde-495d9ec557c5","Type":"ContainerStarted","Data":"956050cbd9878693090c0b8f707e28d048fdf3560d969fd1d26410febf1e366f"}
Jul 24 14:33:14.550495 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:14.550423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-78qtv" event={"ID":"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198","Type":"ContainerStarted","Data":"3e329ac6d7bd083a86178999cc37dbb9477d3fda6d3f2c8de5fb5b74d40ace83"}
Jul 24 14:33:17.572713 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:17.572676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn89v" event={"ID":"bc7a7a38-e8b4-4883-9bde-495d9ec557c5","Type":"ContainerStarted","Data":"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"}
Jul 24 14:33:17.575360 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:17.575326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-78qtv" event={"ID":"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198","Type":"ContainerStarted","Data":"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"}
Jul 24 14:33:17.594322 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:17.594265    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zn89v" podStartSLOduration=1.479166467 podStartE2EDuration="4.594247326s" totalImagesPullingTime="3.115080859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:17.593154741 +0000 UTC m=+661.981174858" watchObservedRunningTime="2026-07-24 14:33:17.594247326 +0000 UTC m=+661.982267441"
Jul 24 14:33:17.613316 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:17.613260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-78qtv" podStartSLOduration=1.122105082 podStartE2EDuration="4.613240495s" totalImagesPullingTime="3.491135413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:17.611589837 +0000 UTC m=+661.999609956" watchObservedRunningTime="2026-07-24 14:33:17.613240495 +0000 UTC m=+662.001260611"
Jul 24 14:33:17.650529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:17.650432    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:19.584998 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:19.584934    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-78qtv" podUID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" containerName="authorino" containerID="cri-o://51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208" gracePeriod=30
Jul 24 14:33:19.832014 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:19.831985    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:19.927178 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:19.927145    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsr8b\" (UniqueName: \"kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b\") pod \"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198\" (UID: \"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198\") "
Jul 24 14:33:19.929597 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:19.929537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b" (OuterVolumeSpecName: "kube-api-access-qsr8b") pod "b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" (UID: "b681a61f-45c8-47b6-9cb8-d7ebd3eb0198"). InnerVolumeSpecName "kube-api-access-qsr8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:20.028210 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.028167    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsr8b\" (UniqueName: \"kubernetes.io/projected/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198-kube-api-access-qsr8b\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:33:20.590427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.590334    2560 generic.go:356] "Generic (PLEG): container finished" podID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" containerID="51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208" exitCode=0
Jul 24 14:33:20.590427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.590377    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-78qtv"
Jul 24 14:33:20.590925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.590422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-78qtv" event={"ID":"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198","Type":"ContainerDied","Data":"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"}
Jul 24 14:33:20.590925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.590463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-78qtv" event={"ID":"b681a61f-45c8-47b6-9cb8-d7ebd3eb0198","Type":"ContainerDied","Data":"3e329ac6d7bd083a86178999cc37dbb9477d3fda6d3f2c8de5fb5b74d40ace83"}
Jul 24 14:33:20.590925 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.590481    2560 scope.go:117] "RemoveContainer" containerID="51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"
Jul 24 14:33:20.599078 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.599059    2560 scope.go:117] "RemoveContainer" containerID="51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"
Jul 24 14:33:20.599359 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:20.599340    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208\": container with ID starting with 51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208 not found: ID does not exist" containerID="51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"
Jul 24 14:33:20.599427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.599372    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208"} err="failed to get container status \"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208\": rpc error: code = NotFound desc = could not find container \"51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208\": container with ID starting with 51c2f23fd42e7502f35a86f307a50043f5b0104e34b9b6caeaa3bef0eb957208 not found: ID does not exist"
Jul 24 14:33:20.613613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.613579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:20.618085 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:20.618057    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-78qtv"]
Jul 24 14:33:22.189052 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:22.189015    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" path="/var/lib/kubelet/pods/b681a61f-45c8-47b6-9cb8-d7ebd3eb0198/volumes"
Jul 24 14:33:24.859635 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:24.859604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:28.541419 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:28.541384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:28.703232 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:28.703182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:29.233875 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:29.233838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:41.915790 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:41.915754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:42.163696 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.163662    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwsf7"]
Jul 24 14:33:42.164094 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.164078    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" containerName="authorino"
Jul 24 14:33:42.164140 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.164096    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" containerName="authorino"
Jul 24 14:33:42.164187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.164162    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b681a61f-45c8-47b6-9cb8-d7ebd3eb0198" containerName="authorino"
Jul 24 14:33:42.167285 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.167241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.175675 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.175649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwsf7"]
Jul 24 14:33:42.340261 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.340227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hdm9\" (UniqueName: \"kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9\") pod \"authorino-5d4b67c446-bwsf7\" (UID: \"82301437-6e44-4ac7-89b5-264a3600a23a\") " pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.437973 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.437886    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwsf7"]
Jul 24 14:33:42.438208 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:42.438188    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9hdm9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-bwsf7" podUID="82301437-6e44-4ac7-89b5-264a3600a23a"
Jul 24 14:33:42.441539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.441514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hdm9\" (UniqueName: \"kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9\") pod \"authorino-5d4b67c446-bwsf7\" (UID: \"82301437-6e44-4ac7-89b5-264a3600a23a\") " pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.452828 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.452800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hdm9\" (UniqueName: \"kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9\") pod \"authorino-5d4b67c446-bwsf7\" (UID: \"82301437-6e44-4ac7-89b5-264a3600a23a\") " pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.487169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.487130    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:42.490590 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.490570    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:42.501830 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.501798    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:42.641138 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.641097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:42.643288 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.643264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlmwp\" (UniqueName: \"kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp\") pod \"authorino-7d686976cf-f4wfr\" (UID: \"de5d941d-466f-4b1a-87b2-dc52ca389c5e\") " pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:42.695473 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.695386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.701913 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.701889    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:42.744322 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.744282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlmwp\" (UniqueName: \"kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp\") pod \"authorino-7d686976cf-f4wfr\" (UID: \"de5d941d-466f-4b1a-87b2-dc52ca389c5e\") " pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:42.756430 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.756395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlmwp\" (UniqueName: \"kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp\") pod \"authorino-7d686976cf-f4wfr\" (UID: \"de5d941d-466f-4b1a-87b2-dc52ca389c5e\") " pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:42.800260 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.800227    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:42.845180 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.845146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hdm9\" (UniqueName: \"kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9\") pod \"82301437-6e44-4ac7-89b5-264a3600a23a\" (UID: \"82301437-6e44-4ac7-89b5-264a3600a23a\") "
Jul 24 14:33:42.847404 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.847374    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9" (OuterVolumeSpecName: "kube-api-access-9hdm9") pod "82301437-6e44-4ac7-89b5-264a3600a23a" (UID: "82301437-6e44-4ac7-89b5-264a3600a23a"). InnerVolumeSpecName "kube-api-access-9hdm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:42.939984 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.939958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:42.942579 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:33:42.942536    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde5d941d_466f_4b1a_87b2_dc52ca389c5e.slice/crio-e03fe18cdd8184cfcee3c73ec07fef92ba6b3e7717a84d27c19e31c3d574e8b5 WatchSource:0}: Error finding container e03fe18cdd8184cfcee3c73ec07fef92ba6b3e7717a84d27c19e31c3d574e8b5: Status 404 returned error can't find the container with id e03fe18cdd8184cfcee3c73ec07fef92ba6b3e7717a84d27c19e31c3d574e8b5
Jul 24 14:33:42.946773 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:42.946727    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hdm9\" (UniqueName: \"kubernetes.io/projected/82301437-6e44-4ac7-89b5-264a3600a23a-kube-api-access-9hdm9\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:33:43.701118 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.701018    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d686976cf-f4wfr" event={"ID":"de5d941d-466f-4b1a-87b2-dc52ca389c5e","Type":"ContainerStarted","Data":"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"}
Jul 24 14:33:43.701118 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.701070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d686976cf-f4wfr" event={"ID":"de5d941d-466f-4b1a-87b2-dc52ca389c5e","Type":"ContainerStarted","Data":"e03fe18cdd8184cfcee3c73ec07fef92ba6b3e7717a84d27c19e31c3d574e8b5"}
Jul 24 14:33:43.701301 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.701117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwsf7"
Jul 24 14:33:43.724526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.724468    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d686976cf-f4wfr" podStartSLOduration=1.320004268 podStartE2EDuration="1.724451107s" totalImagesPullingTime="404.446839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:43.721333644 +0000 UTC m=+688.109353761" watchObservedRunningTime="2026-07-24 14:33:43.724451107 +0000 UTC m=+688.112471223"
Jul 24 14:33:43.755508 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.755463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwsf7"]
Jul 24 14:33:43.761613 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.761579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:43.761817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.761787    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zn89v" podUID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" containerName="authorino" containerID="cri-o://3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d" gracePeriod=30
Jul 24 14:33:43.764121 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:43.764096    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwsf7"]
Jul 24 14:33:44.010769 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.010741    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:44.042310 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.042268    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:33:44.042647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.042632    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" containerName="authorino"
Jul 24 14:33:44.042647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.042645    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" containerName="authorino"
Jul 24 14:33:44.042820 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.042701    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" containerName="authorino"
Jul 24 14:33:44.045460 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.045436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.048777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.048756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 14:33:44.053127 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.053095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:33:44.160111 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.160069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc8ng\" (UniqueName: \"kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng\") pod \"bc7a7a38-e8b4-4883-9bde-495d9ec557c5\" (UID: \"bc7a7a38-e8b4-4883-9bde-495d9ec557c5\") "
Jul 24 14:33:44.160291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.160256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jswz5\" (UniqueName: \"kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.160332 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.160305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.162333 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.162299    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng" (OuterVolumeSpecName: "kube-api-access-xc8ng") pod "bc7a7a38-e8b4-4883-9bde-495d9ec557c5" (UID: "bc7a7a38-e8b4-4883-9bde-495d9ec557c5"). InnerVolumeSpecName "kube-api-access-xc8ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:44.189686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.189654    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82301437-6e44-4ac7-89b5-264a3600a23a" path="/var/lib/kubelet/pods/82301437-6e44-4ac7-89b5-264a3600a23a/volumes"
Jul 24 14:33:44.261622 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.261514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jswz5\" (UniqueName: \"kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.261622 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.261594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.261824 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.261673    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc8ng\" (UniqueName: \"kubernetes.io/projected/bc7a7a38-e8b4-4883-9bde-495d9ec557c5-kube-api-access-xc8ng\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:33:44.264231 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.264204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.271386 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.271360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jswz5\" (UniqueName: \"kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5\") pod \"authorino-6bb7594699-w79zc\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") " pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.357808 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.357755    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:33:44.534218 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.534190    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:33:44.536939 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:33:44.536912    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf306a09_cc21_4f4e_a196_a18fc746eef5.slice/crio-cd1fbb74685827a468bc7de5bc3b715003b4790ebe869b035b065d7c4db70114 WatchSource:0}: Error finding container cd1fbb74685827a468bc7de5bc3b715003b4790ebe869b035b065d7c4db70114: Status 404 returned error can't find the container with id cd1fbb74685827a468bc7de5bc3b715003b4790ebe869b035b065d7c4db70114
Jul 24 14:33:44.707150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.707112    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" containerID="3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d" exitCode=0
Jul 24 14:33:44.707150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.707151    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn89v"
Jul 24 14:33:44.707417 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.707161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn89v" event={"ID":"bc7a7a38-e8b4-4883-9bde-495d9ec557c5","Type":"ContainerDied","Data":"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"}
Jul 24 14:33:44.707417 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.707207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn89v" event={"ID":"bc7a7a38-e8b4-4883-9bde-495d9ec557c5","Type":"ContainerDied","Data":"956050cbd9878693090c0b8f707e28d048fdf3560d969fd1d26410febf1e366f"}
Jul 24 14:33:44.707417 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.707233    2560 scope.go:117] "RemoveContainer" containerID="3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"
Jul 24 14:33:44.708605 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.708582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb7594699-w79zc" event={"ID":"bf306a09-cc21-4f4e-a196-a18fc746eef5","Type":"ContainerStarted","Data":"cd1fbb74685827a468bc7de5bc3b715003b4790ebe869b035b065d7c4db70114"}
Jul 24 14:33:44.715736 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.715719    2560 scope.go:117] "RemoveContainer" containerID="3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"
Jul 24 14:33:44.716020 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:44.716002    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d\": container with ID starting with 3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d not found: ID does not exist" containerID="3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"
Jul 24 14:33:44.716074 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.716028    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d"} err="failed to get container status \"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d\": rpc error: code = NotFound desc = could not find container \"3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d\": container with ID starting with 3425561059a6775b628a204f7f03caa2e9adb09de645151a0569972a1de0273d not found: ID does not exist"
Jul 24 14:33:44.726376 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.726352    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:44.729343 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:44.729319    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn89v"]
Jul 24 14:33:45.716226 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:45.716181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb7594699-w79zc" event={"ID":"bf306a09-cc21-4f4e-a196-a18fc746eef5","Type":"ContainerStarted","Data":"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"}
Jul 24 14:33:45.738446 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:45.738384    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bb7594699-w79zc" podStartSLOduration=1.319415528 podStartE2EDuration="1.738362573s" totalImagesPullingTime="418.947045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:45.736772786 +0000 UTC m=+690.124792904" watchObservedRunningTime="2026-07-24 14:33:45.738362573 +0000 UTC m=+690.126382690"
Jul 24 14:33:45.786192 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:45.786157    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:45.786388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:45.786308    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d686976cf-f4wfr" podUID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" containerName="authorino" containerID="cri-o://cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9" gracePeriod=30
Jul 24 14:33:46.034837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.034807    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:46.077816 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.077786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlmwp\" (UniqueName: \"kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp\") pod \"de5d941d-466f-4b1a-87b2-dc52ca389c5e\" (UID: \"de5d941d-466f-4b1a-87b2-dc52ca389c5e\") "
Jul 24 14:33:46.080065 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.080029    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp" (OuterVolumeSpecName: "kube-api-access-vlmwp") pod "de5d941d-466f-4b1a-87b2-dc52ca389c5e" (UID: "de5d941d-466f-4b1a-87b2-dc52ca389c5e"). InnerVolumeSpecName "kube-api-access-vlmwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:33:46.179410 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.179370    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlmwp\" (UniqueName: \"kubernetes.io/projected/de5d941d-466f-4b1a-87b2-dc52ca389c5e-kube-api-access-vlmwp\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:33:46.189139 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.189102    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7a7a38-e8b4-4883-9bde-495d9ec557c5" path="/var/lib/kubelet/pods/bc7a7a38-e8b4-4883-9bde-495d9ec557c5/volumes"
Jul 24 14:33:46.722435 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.722402    2560 generic.go:356] "Generic (PLEG): container finished" podID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" containerID="cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9" exitCode=0
Jul 24 14:33:46.722944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.722444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d686976cf-f4wfr"
Jul 24 14:33:46.722944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.722488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d686976cf-f4wfr" event={"ID":"de5d941d-466f-4b1a-87b2-dc52ca389c5e","Type":"ContainerDied","Data":"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"}
Jul 24 14:33:46.722944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.722524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d686976cf-f4wfr" event={"ID":"de5d941d-466f-4b1a-87b2-dc52ca389c5e","Type":"ContainerDied","Data":"e03fe18cdd8184cfcee3c73ec07fef92ba6b3e7717a84d27c19e31c3d574e8b5"}
Jul 24 14:33:46.722944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.722541    2560 scope.go:117] "RemoveContainer" containerID="cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"
Jul 24 14:33:46.731003 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.730984    2560 scope.go:117] "RemoveContainer" containerID="cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"
Jul 24 14:33:46.731303 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:46.731281    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9\": container with ID starting with cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9 not found: ID does not exist" containerID="cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"
Jul 24 14:33:46.731405 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.731317    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9"} err="failed to get container status \"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9\": rpc error: code = NotFound desc = could not find container \"cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9\": container with ID starting with cd322de768d94d4f5f68ee97d331dccca53ee04655173df10e6c6d10e4a9e6e9 not found: ID does not exist"
Jul 24 14:33:46.745663 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.745630    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:46.750786 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:46.750758    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d686976cf-f4wfr"]
Jul 24 14:33:48.190404 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.190370    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" path="/var/lib/kubelet/pods/de5d941d-466f-4b1a-87b2-dc52ca389c5e/volumes"
Jul 24 14:33:48.845180 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.845149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:48.855596 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.855548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:33:48.855981 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.855966    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" containerName="authorino"
Jul 24 14:33:48.856067 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.855985    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" containerName="authorino"
Jul 24 14:33:48.856067 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.856041    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de5d941d-466f-4b1a-87b2-dc52ca389c5e" containerName="authorino"
Jul 24 14:33:48.860540 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.860517    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:48.865100 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.865074    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 14:33:48.865232 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.865077    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s5p4r\""
Jul 24 14:33:48.866096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.866079    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 14:33:48.884751 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.884721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:33:48.901445 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.901416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk97m\" (UniqueName: \"kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:48.901643 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:48.901500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.002124 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.002091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk97m\" (UniqueName: \"kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.002309 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.002182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.002357 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:49.002321    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 24 14:33:49.002398 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:33:49.002383    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert podName:1c5a7b34-13e0-4d69-a2be-184f7efdbd17 nodeName:}" failed. No retries permitted until 2026-07-24 14:33:49.502368229 +0000 UTC m=+693.890388323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert") pod "maas-controller-655899cbcf-xrw4j" (UID: "1c5a7b34-13e0-4d69-a2be-184f7efdbd17") : secret "maas-controller-webhook-cert" not found
Jul 24 14:33:49.018301 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.018276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk97m\" (UniqueName: \"kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.024405 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.024347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:49.126885 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.126798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:49.393388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.393297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:49.507854 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.507816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.510444 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.510425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") pod \"maas-controller-655899cbcf-xrw4j\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") " pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.771053 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.770964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:49.913483 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:49.913457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:33:49.915437 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:33:49.915402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5a7b34_13e0_4d69_a2be_184f7efdbd17.slice/crio-a389ffc058c06778787b50e82d993642f9303b1bb4e49445161145d4382f3b8e WatchSource:0}: Error finding container a389ffc058c06778787b50e82d993642f9303b1bb4e49445161145d4382f3b8e: Status 404 returned error can't find the container with id a389ffc058c06778787b50e82d993642f9303b1bb4e49445161145d4382f3b8e
Jul 24 14:33:50.745155 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:50.745106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-655899cbcf-xrw4j" event={"ID":"1c5a7b34-13e0-4d69-a2be-184f7efdbd17","Type":"ContainerStarted","Data":"a389ffc058c06778787b50e82d993642f9303b1bb4e49445161145d4382f3b8e"}
Jul 24 14:33:51.888579 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:51.888516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:51.986354 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:51.986322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:52.756154 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:52.756116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-655899cbcf-xrw4j" event={"ID":"1c5a7b34-13e0-4d69-a2be-184f7efdbd17","Type":"ContainerStarted","Data":"fc0dc3d7fd98888180557e7b370ed469e424114b899a1079401b148895e72268"}
Jul 24 14:33:52.756377 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:52.756176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:33:52.777618 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:52.777533    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-655899cbcf-xrw4j" podStartSLOduration=2.6938344770000002 podStartE2EDuration="4.777519403s" totalImagesPullingTime="2.083684926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:52.776743961 +0000 UTC m=+697.164764077" watchObservedRunningTime="2026-07-24 14:33:52.777519403 +0000 UTC m=+697.165539528"
Jul 24 14:33:55.778486 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:55.778452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:33:55.883291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:33:55.883257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:03.646026 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.645952    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:34:03.646612 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.646183    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-655899cbcf-xrw4j" podUID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" containerName="manager" containerID="cri-o://fc0dc3d7fd98888180557e7b370ed469e424114b899a1079401b148895e72268" gracePeriod=30
Jul 24 14:34:03.648114 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.648092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:34:03.807929 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.807897    2560 generic.go:356] "Generic (PLEG): container finished" podID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" containerID="fc0dc3d7fd98888180557e7b370ed469e424114b899a1079401b148895e72268" exitCode=0
Jul 24 14:34:03.808075 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.807968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-655899cbcf-xrw4j" event={"ID":"1c5a7b34-13e0-4d69-a2be-184f7efdbd17","Type":"ContainerDied","Data":"fc0dc3d7fd98888180557e7b370ed469e424114b899a1079401b148895e72268"}
Jul 24 14:34:03.889517 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.889493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:34:03.938882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.938798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk97m\" (UniqueName: \"kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m\") pod \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") "
Jul 24 14:34:03.938882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.938874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") pod \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\" (UID: \"1c5a7b34-13e0-4d69-a2be-184f7efdbd17\") "
Jul 24 14:34:03.941162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.941131    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1c5a7b34-13e0-4d69-a2be-184f7efdbd17" (UID: "1c5a7b34-13e0-4d69-a2be-184f7efdbd17"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:34:03.941286 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:03.941214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m" (OuterVolumeSpecName: "kube-api-access-mk97m") pod "1c5a7b34-13e0-4d69-a2be-184f7efdbd17" (UID: "1c5a7b34-13e0-4d69-a2be-184f7efdbd17"). InnerVolumeSpecName "kube-api-access-mk97m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:34:04.040462 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.040429    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-webhook-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:34:04.040462 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.040457    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk97m\" (UniqueName: \"kubernetes.io/projected/1c5a7b34-13e0-4d69-a2be-184f7efdbd17-kube-api-access-mk97m\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:34:04.813918 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.813885    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-655899cbcf-xrw4j"
Jul 24 14:34:04.814416 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.813888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-655899cbcf-xrw4j" event={"ID":"1c5a7b34-13e0-4d69-a2be-184f7efdbd17","Type":"ContainerDied","Data":"a389ffc058c06778787b50e82d993642f9303b1bb4e49445161145d4382f3b8e"}
Jul 24 14:34:04.814416 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.814026    2560 scope.go:117] "RemoveContainer" containerID="fc0dc3d7fd98888180557e7b370ed469e424114b899a1079401b148895e72268"
Jul 24 14:34:04.835612 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.835579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:34:04.840049 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:04.840024    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-655899cbcf-xrw4j"]
Jul 24 14:34:06.189134 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:06.189103    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" path="/var/lib/kubelet/pods/1c5a7b34-13e0-4d69-a2be-184f7efdbd17/volumes"
Jul 24 14:34:23.673806 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:23.673771    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:23.784491 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:23.784447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:24.358950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:24.358912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:24.640263 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:24.640180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:24.950004 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:24.949919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:25.050122 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.050088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:25.057550 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.057522    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"]
Jul 24 14:34:25.057876 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.057864    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" containerName="manager"
Jul 24 14:34:25.057922 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.057878    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" containerName="manager"
Jul 24 14:34:25.057966 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.057958    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5a7b34-13e0-4d69-a2be-184f7efdbd17" containerName="manager"
Jul 24 14:34:25.066220 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.066188    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.068703 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.068675    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 14:34:25.072186 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.072160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"]
Jul 24 14:34:25.233638 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.233536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84789551-2577-4084-8ac7-35438627b39d-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.233798 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.233673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69z2\" (UniqueName: \"kubernetes.io/projected/84789551-2577-4084-8ac7-35438627b39d-kube-api-access-c69z2\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.334966 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.334922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84789551-2577-4084-8ac7-35438627b39d-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.335151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.334988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69z2\" (UniqueName: \"kubernetes.io/projected/84789551-2577-4084-8ac7-35438627b39d-kube-api-access-c69z2\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.335658 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.335640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84789551-2577-4084-8ac7-35438627b39d-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.347302 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.347273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69z2\" (UniqueName: \"kubernetes.io/projected/84789551-2577-4084-8ac7-35438627b39d-kube-api-access-c69z2\") pod \"payload-pre-processing-687dbb6cf6-zgcgc\" (UID: \"84789551-2577-4084-8ac7-35438627b39d\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.377219 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.377178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:25.515295 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.515267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"]
Jul 24 14:34:25.518061 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:34:25.518030    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84789551_2577_4084_8ac7_35438627b39d.slice/crio-f0ecf052d7492b60d64120b7b637ff1541f5d168968124f10fe408fea87a9ba9 WatchSource:0}: Error finding container f0ecf052d7492b60d64120b7b637ff1541f5d168968124f10fe408fea87a9ba9: Status 404 returned error can't find the container with id f0ecf052d7492b60d64120b7b637ff1541f5d168968124f10fe408fea87a9ba9
Jul 24 14:34:25.912575 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:25.912533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc" event={"ID":"84789551-2577-4084-8ac7-35438627b39d","Type":"ContainerStarted","Data":"f0ecf052d7492b60d64120b7b637ff1541f5d168968124f10fe408fea87a9ba9"}
Jul 24 14:34:27.924167 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:27.924071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc" event={"ID":"84789551-2577-4084-8ac7-35438627b39d","Type":"ContainerStarted","Data":"a603c72fd0890f5d56416412a06eae6f08b90aa02b461c1d6a8373bcd3d79cb0"}
Jul 24 14:34:27.924576 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:27.924218    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:27.944407 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:27.944353    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc" podStartSLOduration=0.838094536 podStartE2EDuration="2.944336584s" totalImagesPullingTime="2.106242048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:27.943658789 +0000 UTC m=+732.331678905" watchObservedRunningTime="2026-07-24 14:34:27.944336584 +0000 UTC m=+732.332356704"
Jul 24 14:34:34.872882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:34.872840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:34.974425 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:34.974392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:35.334467 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:35.334391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:34:38.930526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:38.930495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zgcgc"
Jul 24 14:34:52.552668 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:34:52.552634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:09.838762 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:09.838723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:13.268882 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.268848    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"]
Jul 24 14:35:13.271210 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.271192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.274595 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.274575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fcprz\""
Jul 24 14:35:13.275388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.275367    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 14:35:13.275388 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.275374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 14:35:13.275575 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.275395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 14:35:13.283734 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.283713    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"]
Jul 24 14:35:13.303112 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.303075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:13.379267 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7794f945-7eb2-472a-8f41-8fc2e3736a19-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.379447 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.379447 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.379447 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.379590 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdcmm\" (UniqueName: \"kubernetes.io/projected/7794f945-7eb2-472a-8f41-8fc2e3736a19-kube-api-access-vdcmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.379590 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.379500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.480682 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdcmm\" (UniqueName: \"kubernetes.io/projected/7794f945-7eb2-472a-8f41-8fc2e3736a19-kube-api-access-vdcmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.480856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.480856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7794f945-7eb2-472a-8f41-8fc2e3736a19-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.480856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.480856 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.481078 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.480878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.481140 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.481118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.481200 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.481178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.481304 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.481282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.483016 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.482993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7794f945-7eb2-472a-8f41-8fc2e3736a19-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.483423 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.483401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7794f945-7eb2-472a-8f41-8fc2e3736a19-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.492043 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.492019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdcmm\" (UniqueName: \"kubernetes.io/projected/7794f945-7eb2-472a-8f41-8fc2e3736a19-kube-api-access-vdcmm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-htg5r\" (UID: \"7794f945-7eb2-472a-8f41-8fc2e3736a19\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.581944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.581833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:13.733348 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:13.733324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"]
Jul 24 14:35:13.735598 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:35:13.735570    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7794f945_7eb2_472a_8f41_8fc2e3736a19.slice/crio-3c170ca2125e7d26d555e2b665cc06d31ab60f67e9ed7040723d99115f98eeec WatchSource:0}: Error finding container 3c170ca2125e7d26d555e2b665cc06d31ab60f67e9ed7040723d99115f98eeec: Status 404 returned error can't find the container with id 3c170ca2125e7d26d555e2b665cc06d31ab60f67e9ed7040723d99115f98eeec
Jul 24 14:35:14.142858 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:14.142816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r" event={"ID":"7794f945-7eb2-472a-8f41-8fc2e3736a19","Type":"ContainerStarted","Data":"3c170ca2125e7d26d555e2b665cc06d31ab60f67e9ed7040723d99115f98eeec"}
Jul 24 14:35:15.148756 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:15.148715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r" event={"ID":"7794f945-7eb2-472a-8f41-8fc2e3736a19","Type":"ContainerStarted","Data":"13f782a03d93ccd8d9f88ee5c878e95819120d3d99b82d0bfc05c6ad178c6cc2"}
Jul 24 14:35:15.186851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:15.186741    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r" podStartSLOduration=1.000264052 podStartE2EDuration="2.186723588s" totalImagesPullingTime="1.186459536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:15.184714139 +0000 UTC m=+779.572734254" watchObservedRunningTime="2026-07-24 14:35:15.186723588 +0000 UTC m=+779.574743704"
Jul 24 14:35:16.853385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:16.853352    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"]
Jul 24 14:35:16.856932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:16.856915    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:16.859768 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:16.859750    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 14:35:16.866166 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:16.866145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"]
Jul 24 14:35:16.883044 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:16.883006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:17.016096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.016320 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.016320 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.016320 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.016476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.016476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.016363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdcv\" (UniqueName: \"kubernetes.io/projected/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-kube-api-access-dtdcv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.117816 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.117816 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.117816 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdcv\" (UniqueName: \"kubernetes.io/projected/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-kube-api-access-dtdcv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118090 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.117902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118252 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.118190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118252 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.118208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.118346 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.118282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.120201 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.120179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.120463 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.120444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.129381 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.129362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdcv\" (UniqueName: \"kubernetes.io/projected/1e6a001a-e9be-4d4f-b148-aa0a914d8f78-kube-api-access-dtdcv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nqwjc\" (UID: \"1e6a001a-e9be-4d4f-b148-aa0a914d8f78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.168922 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.168883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:17.315481 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:17.315412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"]
Jul 24 14:35:17.319179 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:35:17.319150    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6a001a_e9be_4d4f_b148_aa0a914d8f78.slice/crio-7c4da70c7d13dda6c4a67a8a91e679fc52bf1a5a04207a98a73bbff4f624d4d9 WatchSource:0}: Error finding container 7c4da70c7d13dda6c4a67a8a91e679fc52bf1a5a04207a98a73bbff4f624d4d9: Status 404 returned error can't find the container with id 7c4da70c7d13dda6c4a67a8a91e679fc52bf1a5a04207a98a73bbff4f624d4d9
Jul 24 14:35:18.169797 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:18.169754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc" event={"ID":"1e6a001a-e9be-4d4f-b148-aa0a914d8f78","Type":"ContainerStarted","Data":"896c7486830425800dc4b7d011707748a930d3110f74c4454e59767431721108"}
Jul 24 14:35:18.170247 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:18.169838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc" event={"ID":"1e6a001a-e9be-4d4f-b148-aa0a914d8f78","Type":"ContainerStarted","Data":"7c4da70c7d13dda6c4a67a8a91e679fc52bf1a5a04207a98a73bbff4f624d4d9"}
Jul 24 14:35:18.189855 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:18.189806    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc" podStartSLOduration=1.9931243570000001 podStartE2EDuration="2.189789039s" totalImagesPullingTime="196.664682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:18.188974263 +0000 UTC m=+782.576994381" watchObservedRunningTime="2026-07-24 14:35:18.189789039 +0000 UTC m=+782.577809155"
Jul 24 14:35:23.582545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:23.582507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:23.583055 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:23.582636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:23.595547 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:23.595516    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:24.208179 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:24.208141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-htg5r"
Jul 24 14:35:27.169732 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:27.169692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:27.170138 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:27.169768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:27.182625 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:27.182592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:27.221239 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:27.221207    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nqwjc"
Jul 24 14:35:29.391250 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:29.391209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:33.039544 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.039502    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"]
Jul 24 14:35:33.043834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.043811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.047032 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.047005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 14:35:33.053841 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.053818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"]
Jul 24 14:35:33.082580 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.082528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:33.166219 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cbfabec-f466-4c99-9803-6130c2661a09-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.166219 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.166428 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.166428 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.166428 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.166529 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.166426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpnk\" (UniqueName: \"kubernetes.io/projected/9cbfabec-f466-4c99-9803-6130c2661a09-kube-api-access-lqpnk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267360 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpnk\" (UniqueName: \"kubernetes.io/projected/9cbfabec-f466-4c99-9803-6130c2661a09-kube-api-access-lqpnk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267536 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cbfabec-f466-4c99-9803-6130c2661a09-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267536 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267536 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.267796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.267693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.268063 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.268035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.268063 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.268062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.268243 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.268226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.270093 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.270066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cbfabec-f466-4c99-9803-6130c2661a09-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.270239 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.270220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cbfabec-f466-4c99-9803-6130c2661a09-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.279812 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.279793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpnk\" (UniqueName: \"kubernetes.io/projected/9cbfabec-f466-4c99-9803-6130c2661a09-kube-api-access-lqpnk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hl84n\" (UID: \"9cbfabec-f466-4c99-9803-6130c2661a09\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.355913 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.355880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:33.508124 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:33.508028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"]
Jul 24 14:35:33.510879 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:35:33.510855    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cbfabec_f466_4c99_9803_6130c2661a09.slice/crio-ae05971d47bef49457aceac29428838fdac6d32852760a7fa153826604bb392c WatchSource:0}: Error finding container ae05971d47bef49457aceac29428838fdac6d32852760a7fa153826604bb392c: Status 404 returned error can't find the container with id ae05971d47bef49457aceac29428838fdac6d32852760a7fa153826604bb392c
Jul 24 14:35:34.243809 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:34.243773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n" event={"ID":"9cbfabec-f466-4c99-9803-6130c2661a09","Type":"ContainerStarted","Data":"915663ddab0b549fbeec508841ca85b4c4bbaee959d1fa4ba5fe40a4f99d1a41"}
Jul 24 14:35:34.244215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:34.243824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n" event={"ID":"9cbfabec-f466-4c99-9803-6130c2661a09","Type":"ContainerStarted","Data":"ae05971d47bef49457aceac29428838fdac6d32852760a7fa153826604bb392c"}
Jul 24 14:35:34.276350 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:34.276277    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n" podStartSLOduration=1.107285213 podStartE2EDuration="1.27625505s" totalImagesPullingTime="168.969837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:34.273698655 +0000 UTC m=+798.661718770" watchObservedRunningTime="2026-07-24 14:35:34.27625505 +0000 UTC m=+798.664275168"
Jul 24 14:35:38.774291 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.774097    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"]
Jul 24 14:35:38.777905 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.777887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.781645 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.781619    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 14:35:38.788204 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.788180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"]
Jul 24 14:35:38.817683 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.817649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:35:38.819770 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.819746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.819926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.819778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.819926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.819816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.819926 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.819832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5cd\" (UniqueName: \"kubernetes.io/projected/e77f8dfe-7e41-4d75-896f-bd9877798c0c-kube-api-access-kj5cd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.820121 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.819997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.820121 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.820034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921505 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921505 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921764 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921764 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5cd\" (UniqueName: \"kubernetes.io/projected/e77f8dfe-7e41-4d75-896f-bd9877798c0c-kube-api-access-kj5cd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.921869 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.922012 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.921943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.922128 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.922103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.924042 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.924020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e77f8dfe-7e41-4d75-896f-bd9877798c0c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.924361 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.924345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e77f8dfe-7e41-4d75-896f-bd9877798c0c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:38.933205 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:38.933182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5cd\" (UniqueName: \"kubernetes.io/projected/e77f8dfe-7e41-4d75-896f-bd9877798c0c-kube-api-access-kj5cd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg\" (UID: \"e77f8dfe-7e41-4d75-896f-bd9877798c0c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:39.087684 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:39.087601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:39.226821 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:39.226792    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"]
Jul 24 14:35:39.228827 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:35:39.228803    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode77f8dfe_7e41_4d75_896f_bd9877798c0c.slice/crio-7f82d9e67bfaeac7afb3c7aa6654b8491fb24cc6175a79105dcd6dbf1fccdc2a WatchSource:0}: Error finding container 7f82d9e67bfaeac7afb3c7aa6654b8491fb24cc6175a79105dcd6dbf1fccdc2a: Status 404 returned error can't find the container with id 7f82d9e67bfaeac7afb3c7aa6654b8491fb24cc6175a79105dcd6dbf1fccdc2a
Jul 24 14:35:39.274504 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:39.274466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg" event={"ID":"e77f8dfe-7e41-4d75-896f-bd9877798c0c","Type":"ContainerStarted","Data":"7f82d9e67bfaeac7afb3c7aa6654b8491fb24cc6175a79105dcd6dbf1fccdc2a"}
Jul 24 14:35:40.280740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:40.280704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg" event={"ID":"e77f8dfe-7e41-4d75-896f-bd9877798c0c","Type":"ContainerStarted","Data":"5cadebb428285094999392f8519b08af9d4b3cb447145de2cb00e92ceeb7cf81"}
Jul 24 14:35:40.301500 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:40.301446    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg" podStartSLOduration=2.119303033 podStartE2EDuration="2.301428219s" totalImagesPullingTime="182.125186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:40.299263723 +0000 UTC m=+804.687283838" watchObservedRunningTime="2026-07-24 14:35:40.301428219 +0000 UTC m=+804.689448335"
Jul 24 14:35:43.357077 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:43.357031    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:43.357479 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:43.357107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:43.369630 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:43.369605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:44.314619 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:44.314592    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hl84n"
Jul 24 14:35:49.087963 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:49.087914    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:49.088358 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:49.088024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:49.101380 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:49.101351    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:35:49.339973 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:35:49.339880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg"
Jul 24 14:36:24.293224 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:24.293189    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:36:26.052449 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.052409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-784cd7df58-xfqz8"]
Jul 24 14:36:26.056207 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.056184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.064067 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.064043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784cd7df58-xfqz8"]
Jul 24 14:36:26.177089 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.177030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctv6\" (UniqueName: \"kubernetes.io/projected/202ad90d-1da5-4873-a036-6f4182f663f5-kube-api-access-8ctv6\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.177089 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.177090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/202ad90d-1da5-4873-a036-6f4182f663f5-tls-cert\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.277707 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.277676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctv6\" (UniqueName: \"kubernetes.io/projected/202ad90d-1da5-4873-a036-6f4182f663f5-kube-api-access-8ctv6\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.277890 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.277715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/202ad90d-1da5-4873-a036-6f4182f663f5-tls-cert\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.280443 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.280415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/202ad90d-1da5-4873-a036-6f4182f663f5-tls-cert\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.291011 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.290981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctv6\" (UniqueName: \"kubernetes.io/projected/202ad90d-1da5-4873-a036-6f4182f663f5-kube-api-access-8ctv6\") pod \"authorino-784cd7df58-xfqz8\" (UID: \"202ad90d-1da5-4873-a036-6f4182f663f5\") " pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.366071 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.366042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784cd7df58-xfqz8"
Jul 24 14:36:26.373258 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.373233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:36:26.514776 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.514754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784cd7df58-xfqz8"]
Jul 24 14:36:26.516813 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:36:26.516780    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod202ad90d_1da5_4873_a036_6f4182f663f5.slice/crio-c6c8ab935b5557c5192f5fc1788d0383480415c2f74036ca73e66e06f80242f6 WatchSource:0}: Error finding container c6c8ab935b5557c5192f5fc1788d0383480415c2f74036ca73e66e06f80242f6: Status 404 returned error can't find the container with id c6c8ab935b5557c5192f5fc1788d0383480415c2f74036ca73e66e06f80242f6
Jul 24 14:36:26.531951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:26.531913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:36:27.516546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.516501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784cd7df58-xfqz8" event={"ID":"202ad90d-1da5-4873-a036-6f4182f663f5","Type":"ContainerStarted","Data":"078fc6363d58757d0b51d4f1f1df52e1e5d882c180ed7e22a747b5b74401126b"}
Jul 24 14:36:27.516941 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.516577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784cd7df58-xfqz8" event={"ID":"202ad90d-1da5-4873-a036-6f4182f663f5","Type":"ContainerStarted","Data":"c6c8ab935b5557c5192f5fc1788d0383480415c2f74036ca73e66e06f80242f6"}
Jul 24 14:36:27.568321 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.568258    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-784cd7df58-xfqz8" podStartSLOduration=1.2197032700000001 podStartE2EDuration="1.568233087s" totalImagesPullingTime="348.529817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:27.544222148 +0000 UTC m=+851.932242271" watchObservedRunningTime="2026-07-24 14:36:27.568233087 +0000 UTC m=+851.956253206"
Jul 24 14:36:27.569172 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.569146    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:36:27.569544 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.569517    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6bb7594699-w79zc" podUID="bf306a09-cc21-4f4e-a196-a18fc746eef5" containerName="authorino" containerID="cri-o://4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5" gracePeriod=30
Jul 24 14:36:27.637204 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.637170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:36:27.732902 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.732871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:36:27.822086 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.822062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:36:27.894647 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.894618    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert\") pod \"bf306a09-cc21-4f4e-a196-a18fc746eef5\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") "
Jul 24 14:36:27.894803 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.894718    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jswz5\" (UniqueName: \"kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5\") pod \"bf306a09-cc21-4f4e-a196-a18fc746eef5\" (UID: \"bf306a09-cc21-4f4e-a196-a18fc746eef5\") "
Jul 24 14:36:27.896851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.896814    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5" (OuterVolumeSpecName: "kube-api-access-jswz5") pod "bf306a09-cc21-4f4e-a196-a18fc746eef5" (UID: "bf306a09-cc21-4f4e-a196-a18fc746eef5"). InnerVolumeSpecName "kube-api-access-jswz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:36:27.905800 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.905771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf306a09-cc21-4f4e-a196-a18fc746eef5" (UID: "bf306a09-cc21-4f4e-a196-a18fc746eef5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:36:27.995834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.995798    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf306a09-cc21-4f4e-a196-a18fc746eef5-tls-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:36:27.995834 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:27.995826    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jswz5\" (UniqueName: \"kubernetes.io/projected/bf306a09-cc21-4f4e-a196-a18fc746eef5-kube-api-access-jswz5\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:36:28.522616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.522506    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf306a09-cc21-4f4e-a196-a18fc746eef5" containerID="4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5" exitCode=0
Jul 24 14:36:28.522616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.522569    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb7594699-w79zc"
Jul 24 14:36:28.522616 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.522577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb7594699-w79zc" event={"ID":"bf306a09-cc21-4f4e-a196-a18fc746eef5","Type":"ContainerDied","Data":"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"}
Jul 24 14:36:28.523176 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.522627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb7594699-w79zc" event={"ID":"bf306a09-cc21-4f4e-a196-a18fc746eef5","Type":"ContainerDied","Data":"cd1fbb74685827a468bc7de5bc3b715003b4790ebe869b035b065d7c4db70114"}
Jul 24 14:36:28.523176 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.522650    2560 scope.go:117] "RemoveContainer" containerID="4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"
Jul 24 14:36:28.532729 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.532707    2560 scope.go:117] "RemoveContainer" containerID="4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"
Jul 24 14:36:28.533103 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:36:28.533077    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5\": container with ID starting with 4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5 not found: ID does not exist" containerID="4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"
Jul 24 14:36:28.533197 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.533115    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5"} err="failed to get container status \"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5\": rpc error: code = NotFound desc = could not find container \"4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5\": container with ID starting with 4e4e7355603f73fb389db778022fc2f8f045e0cd21d7b9103886ef86b8cd5eb5 not found: ID does not exist"
Jul 24 14:36:28.542237 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.542212    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:36:28.546376 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:28.546354    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bb7594699-w79zc"]
Jul 24 14:36:30.189541 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:36:30.189505    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf306a09-cc21-4f4e-a196-a18fc746eef5" path="/var/lib/kubelet/pods/bf306a09-cc21-4f4e-a196-a18fc746eef5/volumes"
Jul 24 14:37:12.903160 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:37:12.903121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:37:16.468817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:37:16.468722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:37:16.573476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:37:16.573445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:37:23.348150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:37:23.348113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:37:23.449649 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:37:23.449614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:38:32.095499 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:38:32.095466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:38:33.524266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:38:33.524218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:38:34.748893 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:38:34.748850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:20.906782 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:20.906745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:20.998681 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:20.998646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:21.163319 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:21.163239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:27.644073 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:27.644038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:27.712977 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:27.712938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:27.800759 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:27.800724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:27.901507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:27.901426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:28.035811 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:28.035776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:34.534988 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:34.534955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:39:36.074940 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:39:36.074900    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:41:37.475193 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:41:37.475103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:42:43.786328 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:42:43.786287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:45:29.331744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:45:29.331675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:45:29.418096 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:45:29.418048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:46:43.656150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:46:43.656070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:47:16.034443 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.034408    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:16.034936 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.034813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf306a09-cc21-4f4e-a196-a18fc746eef5" containerName="authorino"
Jul 24 14:47:16.034936 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.034824    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf306a09-cc21-4f4e-a196-a18fc746eef5" containerName="authorino"
Jul 24 14:47:16.034936 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.034880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf306a09-cc21-4f4e-a196-a18fc746eef5" containerName="authorino"
Jul 24 14:47:16.037924 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.037904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.040603 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.040579    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e842d7f9-kserve-self-signed-certs\""
Jul 24 14:47:16.057690 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.057661    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:16.073860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.073825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:47:16.112350 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.112350 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.112605 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56bb\" (UniqueName: \"kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.112605 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.112605 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.112731 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.112618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214410 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214618 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214618 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56bb\" (UniqueName: \"kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214765 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214728    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214872 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.214928 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.214866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.215079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.215059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.216915 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.216892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.217479 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.217463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.223706 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.223687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56bb\" (UniqueName: \"kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb\") pod \"e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") " pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.347694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.347660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:16.490699 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.490672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:16.492824 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:47:16.492789    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec76a448_2433_4d5d_83cf_c92886947bf1.slice/crio-56e4e797b4539144bd04b03c9329584786a2c1275c0d0780a555f074f14540cc WatchSource:0}: Error finding container 56e4e797b4539144bd04b03c9329584786a2c1275c0d0780a555f074f14540cc: Status 404 returned error can't find the container with id 56e4e797b4539144bd04b03c9329584786a2c1275c0d0780a555f074f14540cc
Jul 24 14:47:16.731159 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.731063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" event={"ID":"ec76a448-2433-4d5d-83cf-c92886947bf1","Type":"ContainerStarted","Data":"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"}
Jul 24 14:47:16.731159 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.731110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" event={"ID":"ec76a448-2433-4d5d-83cf-c92886947bf1","Type":"ContainerStarted","Data":"56e4e797b4539144bd04b03c9329584786a2c1275c0d0780a555f074f14540cc"}
Jul 24 14:47:16.752106 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:16.752055    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" podStartSLOduration=0.752040099 podStartE2EDuration="752.040099ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:47:16.751326312 +0000 UTC m=+1501.139346428" watchObservedRunningTime="2026-07-24 14:47:16.752040099 +0000 UTC m=+1501.140060251"
Jul 24 14:47:22.103156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:22.103117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:47:26.348197 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:26.348152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:26.348729 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:26.348301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:26.361305 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:26.361271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:26.794385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:26.794298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:39.234452 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:39.234375    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:40.548130 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:40.548089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:47:40.613624 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:40.613593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:47:54.253975 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.253934    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" podUID="ec76a448-2433-4d5d-83cf-c92886947bf1" containerName="main" containerID="cri-o://46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053" gracePeriod=45
Jul 24 14:47:54.507422 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.507363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:54.593694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593655    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.593694 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593700    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.593954 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g56bb\" (UniqueName: \"kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.593954 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.593954 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.593954 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.593879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home\") pod \"ec76a448-2433-4d5d-83cf-c92886947bf1\" (UID: \"ec76a448-2433-4d5d-83cf-c92886947bf1\") "
Jul 24 14:47:54.594162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.594058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:54.594162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.594148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:54.594272 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.594211    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home" (OuterVolumeSpecName: "home") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:54.596071 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.596045    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm" (OuterVolumeSpecName: "dshm") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:47:54.596467 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.596442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:47:54.596467 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.596457    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb" (OuterVolumeSpecName: "kube-api-access-g56bb") pod "ec76a448-2433-4d5d-83cf-c92886947bf1" (UID: "ec76a448-2433-4d5d-83cf-c92886947bf1"). InnerVolumeSpecName "kube-api-access-g56bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:47:54.695050 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.694999    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.695050 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.695044    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec76a448-2433-4d5d-83cf-c92886947bf1-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.695050 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.695054    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.695050 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.695062    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56bb\" (UniqueName: \"kubernetes.io/projected/ec76a448-2433-4d5d-83cf-c92886947bf1-kube-api-access-g56bb\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.695050 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.695072    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.695363 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.695081    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec76a448-2433-4d5d-83cf-c92886947bf1-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:47:54.916342 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.916303    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec76a448-2433-4d5d-83cf-c92886947bf1" containerID="46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053" exitCode=0
Jul 24 14:47:54.916342 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.916348    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"
Jul 24 14:47:54.916672 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.916390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" event={"ID":"ec76a448-2433-4d5d-83cf-c92886947bf1","Type":"ContainerDied","Data":"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"}
Jul 24 14:47:54.916672 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.916439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4" event={"ID":"ec76a448-2433-4d5d-83cf-c92886947bf1","Type":"ContainerDied","Data":"56e4e797b4539144bd04b03c9329584786a2c1275c0d0780a555f074f14540cc"}
Jul 24 14:47:54.916672 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.916459    2560 scope.go:117] "RemoveContainer" containerID="46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"
Jul 24 14:47:54.926045 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.926027    2560 scope.go:117] "RemoveContainer" containerID="46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"
Jul 24 14:47:54.926386 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:47:54.926365    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053\": container with ID starting with 46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053 not found: ID does not exist" containerID="46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"
Jul 24 14:47:54.926439 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.926397    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053"} err="failed to get container status \"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053\": rpc error: code = NotFound desc = could not find container \"46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053\": container with ID starting with 46493fc51c6a43dc85416ad1d89dc48f2ed02f7de9f4e10c9a0b318a9b63b053 not found: ID does not exist"
Jul 24 14:47:54.939893 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.939861    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:54.949031 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:54.949007    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e842d7f9-kserve-767f4b594c-2ltx4"]
Jul 24 14:47:56.190777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:47:56.190746    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec76a448-2433-4d5d-83cf-c92886947bf1" path="/var/lib/kubelet/pods/ec76a448-2433-4d5d-83cf-c92886947bf1/volumes"
Jul 24 14:49:21.945419 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:49:21.945331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:50:33.269455 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:50:33.269416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:50:50.254456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:50:50.254421    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:14.144499 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:14.144463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:17.529924 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:17.529891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:17.630465 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:17.630431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:18.055934 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:18.055899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:24.609514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:24.609477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:24.760629 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:24.760597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:24.881665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:24.881580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:25.283826 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:25.283728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:25.528044 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:25.528009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:27.914347 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:27.914306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:28.021671 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:28.021637    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:28.173157 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:28.173080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:28.381407 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:28.381375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:28.894424 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:28.894343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:29.053132 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.053097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:29.088208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.088172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:51:29.088636 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.088617    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec76a448-2433-4d5d-83cf-c92886947bf1" containerName="main"
Jul 24 14:51:29.088740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.088643    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec76a448-2433-4d5d-83cf-c92886947bf1" containerName="main"
Jul 24 14:51:29.088740 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.088714    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec76a448-2433-4d5d-83cf-c92886947bf1" containerName="main"
Jul 24 14:51:29.091999 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.091981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.109654 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.109629    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2e2d5bdd\""
Jul 24 14:51:29.111378 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.111362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2e2d5bdd-dockercfg-g8mmc\""
Jul 24 14:51:29.112799 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.112782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnxm\" (UniqueName: \"kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.112898 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.112874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.124394 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.124364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:51:29.213894 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.213797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnxm\" (UniqueName: \"kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.214227 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.214199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.214950 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.214926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.230154 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.230126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnxm\" (UniqueName: \"kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm\") pod \"payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.402618 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.402579    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.549056 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.549027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:51:29.550929 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:51:29.550905    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f768ac3_9f02_4429_aa43_9dba9392f719.slice/crio-f886500e92d3a5a723c501cc0968db9c42e06e34b1c35b7df1f4132d7eeeda90 WatchSource:0}: Error finding container f886500e92d3a5a723c501cc0968db9c42e06e34b1c35b7df1f4132d7eeeda90: Status 404 returned error can't find the container with id f886500e92d3a5a723c501cc0968db9c42e06e34b1c35b7df1f4132d7eeeda90
Jul 24 14:51:29.944630 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.944597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" event={"ID":"3f768ac3-9f02-4429-aa43-9dba9392f719","Type":"ContainerStarted","Data":"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"}
Jul 24 14:51:29.944827 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.944649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" event={"ID":"3f768ac3-9f02-4429-aa43-9dba9392f719","Type":"ContainerStarted","Data":"f886500e92d3a5a723c501cc0968db9c42e06e34b1c35b7df1f4132d7eeeda90"}
Jul 24 14:51:29.944827 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.944735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:51:29.969161 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:29.969106    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" podStartSLOduration=0.969090275 podStartE2EDuration="969.090275ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:51:29.968672463 +0000 UTC m=+1754.356692580" watchObservedRunningTime="2026-07-24 14:51:29.969090275 +0000 UTC m=+1754.357110390"
Jul 24 14:51:33.629828 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:33.629782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:51:40.951633 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:51:40.951595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:52:04.375965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.375918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:04.405158 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.405125    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:52:04.405374 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.405337    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" podUID="3f768ac3-9f02-4429-aa43-9dba9392f719" containerName="payload-pre-processing" containerID="cri-o://cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b" gracePeriod=30
Jul 24 14:52:04.658979 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.658953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:52:04.754453 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.754418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume\") pod \"3f768ac3-9f02-4429-aa43-9dba9392f719\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") "
Jul 24 14:52:04.754665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.754509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xnxm\" (UniqueName: \"kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm\") pod \"3f768ac3-9f02-4429-aa43-9dba9392f719\" (UID: \"3f768ac3-9f02-4429-aa43-9dba9392f719\") "
Jul 24 14:52:04.754839 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.754816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f768ac3-9f02-4429-aa43-9dba9392f719" (UID: "3f768ac3-9f02-4429-aa43-9dba9392f719"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:52:04.756824 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.756801    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm" (OuterVolumeSpecName: "kube-api-access-2xnxm") pod "3f768ac3-9f02-4429-aa43-9dba9392f719" (UID: "3f768ac3-9f02-4429-aa43-9dba9392f719"). InnerVolumeSpecName "kube-api-access-2xnxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:52:04.855778 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.855739    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xnxm\" (UniqueName: \"kubernetes.io/projected/3f768ac3-9f02-4429-aa43-9dba9392f719-kube-api-access-2xnxm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:52:04.855778 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:04.855773    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f768ac3-9f02-4429-aa43-9dba9392f719-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:52:05.113361 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.113321    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f768ac3-9f02-4429-aa43-9dba9392f719" containerID="cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b" exitCode=0
Jul 24 14:52:05.113539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.113370    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"
Jul 24 14:52:05.113539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.113408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" event={"ID":"3f768ac3-9f02-4429-aa43-9dba9392f719","Type":"ContainerDied","Data":"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"}
Jul 24 14:52:05.113539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.113467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8" event={"ID":"3f768ac3-9f02-4429-aa43-9dba9392f719","Type":"ContainerDied","Data":"f886500e92d3a5a723c501cc0968db9c42e06e34b1c35b7df1f4132d7eeeda90"}
Jul 24 14:52:05.113539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.113490    2560 scope.go:117] "RemoveContainer" containerID="cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"
Jul 24 14:52:05.123058 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.123039    2560 scope.go:117] "RemoveContainer" containerID="cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"
Jul 24 14:52:05.123307 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:52:05.123287    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b\": container with ID starting with cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b not found: ID does not exist" containerID="cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"
Jul 24 14:52:05.123376 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.123314    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b"} err="failed to get container status \"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b\": rpc error: code = NotFound desc = could not find container \"cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b\": container with ID starting with cdcd94e4d5e4ccbb0158140587d2950584c3ddcad70a0a06f7228c6426236e3b not found: ID does not exist"
Jul 24 14:52:05.136744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.136716    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:52:05.141968 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.141944    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2e2d5bdd-7d6ff55b-mhxk8"]
Jul 24 14:52:05.987755 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:05.987721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:06.189836 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:06.189804    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f768ac3-9f02-4429-aa43-9dba9392f719" path="/var/lib/kubelet/pods/3f768ac3-9f02-4429-aa43-9dba9392f719/volumes"
Jul 24 14:52:08.799771 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:08.799700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:08.999197 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:08.999157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:09.277009 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:09.276976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:09.674215 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:09.674177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:09.854137 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:09.854105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:10.099772 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:10.099731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:10.321022 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:10.320982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:10.432427 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:10.432331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:13.482706 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:13.482671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:13.767129 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:13.767024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:13.957234 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:13.957203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:14.502241 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:14.502212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:14.692307 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:14.692279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:49.084907 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:49.084868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:49.208702 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:49.208669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:49.312584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:49.312522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:53.539507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:53.539468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:53.751777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:53.751729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:53.976725 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:53.976688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:54.230260 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:54.230178    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:54.590116 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:54.590027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:54.705861 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:54.705822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:57.504723 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:57.504684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:57.594852 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:57.594814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:57.708400 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:57.708359    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:57.806040 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:57.805932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:58.254084 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:58.254044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:52:58.342221 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:52:58.342187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:34.081142 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:34.081110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:34.187288 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:34.187248    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:34.257783 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:34.257748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:38.608120 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:38.608036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:40.032999 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:40.032964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:40.277016 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:40.276983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:40.528855 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:40.528817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:40.870530 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:40.870497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:41.033266 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:41.033233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:43.778896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:43.778862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:43.910724 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:43.910686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:44.016953 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:44.016918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:44.120760 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:44.120729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:44.542944 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:44.542863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:44.641954 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:44.641917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:53:55.478793 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:53:55.478758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:24.521053 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:24.521013    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:24.605884 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:24.605854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:24.688791 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:24.688754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:28.904009 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:28.903973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:29.074764 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:29.074727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:29.333432 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:29.333347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:29.851712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:29.851678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:29.952128 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:29.952095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:30.057389 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:30.057353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:31.669569 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:31.669531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:38.189393 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:38.189354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:38.291400 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:38.291368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:38.390778 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:38.390739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:38.491584 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:38.491462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:38.989462 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:38.989424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:45.665250 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:45.665216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:54:45.799488 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:54:45.799448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:05.038334 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:05.038297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:12.066932 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:12.066848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:12.148149 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:12.148118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:12.274519 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:12.274469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:12.434166 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:12.434129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:28.386087 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:28.386049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:35.195830 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:35.195796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:35.272151 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:35.272121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:35.381817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:35.381783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:35.482222 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:35.482146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:46.011744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:46.011712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:46.901481 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:46.901446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:54.491087 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:54.491042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:54.600522 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:54.600486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:54.691201 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:54.691170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:54.790907 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:54.790819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:55.679939 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:55.679891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:55.773650 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:55.773607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:55.872719 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:55.872682    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:55:57.640796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:55:57.640761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:04.150841 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:04.150793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:04.252715 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:04.252678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:04.914251 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:04.914219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:11.696532 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:11.696500    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:11.827259 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:11.827216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:12.069102 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:12.069010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:12.320737 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:12.320651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:12.451539 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:12.451501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:15.348757 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:15.348718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:15.443686 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:15.443647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:15.529754 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:15.529716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:16.052087 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.052057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:16.161089 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.161057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:16.191730 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.191703    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:16.192079 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.192066    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f768ac3-9f02-4429-aa43-9dba9392f719" containerName="payload-pre-processing"
Jul 24 14:56:16.192126 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.192081    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f768ac3-9f02-4429-aa43-9dba9392f719" containerName="payload-pre-processing"
Jul 24 14:56:16.192173 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.192164    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f768ac3-9f02-4429-aa43-9dba9392f719" containerName="payload-pre-processing"
Jul 24 14:56:16.195162 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.195144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.211428 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.211402    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d768479c\""
Jul 24 14:56:16.231426 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.231392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:16.279711 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.279671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kghf\" (UniqueName: \"kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.279896 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.279719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.297860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.297834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:16.381181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.381142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.381599 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.381294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kghf\" (UniqueName: \"kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.382002 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.381983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.396260 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.396227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kghf\" (UniqueName: \"kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf\") pod \"payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.505271 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.505236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:16.643164 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:16.643139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:16.646136 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:56:16.646104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cab1bf6_52d4_4a42_ab02_bd327c5b7660.slice/crio-1d592c54277cb2d06f5e22d0707c36f5833c28a0594bec870c5b60a545b7476d WatchSource:0}: Error finding container 1d592c54277cb2d06f5e22d0707c36f5833c28a0594bec870c5b60a545b7476d: Status 404 returned error can't find the container with id 1d592c54277cb2d06f5e22d0707c36f5833c28a0594bec870c5b60a545b7476d
Jul 24 14:56:17.338796 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:17.338757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" event={"ID":"2cab1bf6-52d4-4a42-ab02-bd327c5b7660","Type":"ContainerStarted","Data":"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"}
Jul 24 14:56:17.339061 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:17.338818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" event={"ID":"2cab1bf6-52d4-4a42-ab02-bd327c5b7660","Type":"ContainerStarted","Data":"1d592c54277cb2d06f5e22d0707c36f5833c28a0594bec870c5b60a545b7476d"}
Jul 24 14:56:17.339061 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:17.338846    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:17.357251 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:17.357197    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" podStartSLOduration=1.357179894 podStartE2EDuration="1.357179894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:56:17.356075686 +0000 UTC m=+2041.744095826" watchObservedRunningTime="2026-07-24 14:56:17.357179894 +0000 UTC m=+2041.745200010"
Jul 24 14:56:19.920706 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:19.920665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:20.641878 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:20.641843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:20.729744 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:20.729708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:21.116450 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:21.116422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:27.906773 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:27.906739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:27.989088 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:27.989057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:28.345939 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:28.345906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:38.867485 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:38.867401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:38.896573 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:38.896513    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:38.896816 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:38.896772    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" podUID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" containerName="payload-pre-processing" containerID="cri-o://e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f" gracePeriod=30
Jul 24 14:56:38.983919 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:38.983888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:39.141402 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.141365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:39.147913 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.147893    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:39.210895 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.210859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kghf\" (UniqueName: \"kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf\") pod \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") "
Jul 24 14:56:39.211071 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.210972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume\") pod \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\" (UID: \"2cab1bf6-52d4-4a42-ab02-bd327c5b7660\") "
Jul 24 14:56:39.211339 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.211313    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cab1bf6-52d4-4a42-ab02-bd327c5b7660" (UID: "2cab1bf6-52d4-4a42-ab02-bd327c5b7660"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:56:39.213456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.213431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf" (OuterVolumeSpecName: "kube-api-access-2kghf") pod "2cab1bf6-52d4-4a42-ab02-bd327c5b7660" (UID: "2cab1bf6-52d4-4a42-ab02-bd327c5b7660"). InnerVolumeSpecName "kube-api-access-2kghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:56:39.312500 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.312458    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.312500 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.312490    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kghf\" (UniqueName: \"kubernetes.io/projected/2cab1bf6-52d4-4a42-ab02-bd327c5b7660-kube-api-access-2kghf\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:56:39.448456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.448360    2560 generic.go:356] "Generic (PLEG): container finished" podID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" containerID="e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f" exitCode=0
Jul 24 14:56:39.448456 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.448404    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"
Jul 24 14:56:39.448665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.448453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" event={"ID":"2cab1bf6-52d4-4a42-ab02-bd327c5b7660","Type":"ContainerDied","Data":"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"}
Jul 24 14:56:39.448665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.448504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5" event={"ID":"2cab1bf6-52d4-4a42-ab02-bd327c5b7660","Type":"ContainerDied","Data":"1d592c54277cb2d06f5e22d0707c36f5833c28a0594bec870c5b60a545b7476d"}
Jul 24 14:56:39.448665 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.448526    2560 scope.go:117] "RemoveContainer" containerID="e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"
Jul 24 14:56:39.457993 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.457977    2560 scope.go:117] "RemoveContainer" containerID="e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"
Jul 24 14:56:39.458297 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:56:39.458278    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f\": container with ID starting with e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f not found: ID does not exist" containerID="e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"
Jul 24 14:56:39.458349 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.458307    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f"} err="failed to get container status \"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f\": rpc error: code = NotFound desc = could not find container \"e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f\": container with ID starting with e33b1af0e0834261ca21d1338750b97bc8195cdcfdb0b42e5b5a5e11737fca5f not found: ID does not exist"
Jul 24 14:56:39.475937 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.475905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:39.480296 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:39.480271    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d768479c-6fdb95b9b-hc2c5"]
Jul 24 14:56:40.189888 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:40.189854    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" path="/var/lib/kubelet/pods/2cab1bf6-52d4-4a42-ab02-bd327c5b7660/volumes"
Jul 24 14:56:43.388476 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:43.388437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:43.826169 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:43.826079    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:50.964550 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:50.964513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.095073 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.095040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.267736 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.267634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.527439 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.527346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.652187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.652150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.751602 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.751538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:51.907629 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:51.907597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:58.835145 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:58.835106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:58.941494 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:58.941464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:59.036018 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:59.035978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:56:59.243231 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:56:59.243197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:05.885575 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:05.885520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:05.982220 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:05.982188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:12.961150 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:12.961103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:13.319387 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:13.319300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:13.713385 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:13.713334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:16.421181 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:16.421139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:16.509240 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:16.509207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:16.587126 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:16.587032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:16.757717 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:16.757685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:17.184727 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.184689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:17.260345 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.260309    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:57:17.260722 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.260708    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" containerName="payload-pre-processing"
Jul 24 14:57:17.260722 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.260723    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" containerName="payload-pre-processing"
Jul 24 14:57:17.260837 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.260782    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cab1bf6-52d4-4a42-ab02-bd327c5b7660" containerName="payload-pre-processing"
Jul 24 14:57:17.265269 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.265243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:17.265485 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.265470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.268507 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.268489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0ac5a605\""
Jul 24 14:57:17.277739 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.277715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:57:17.376177 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.376139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.376353 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.376254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw2td\" (UniqueName: \"kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.477586 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.477471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.477965 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.477606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw2td\" (UniqueName: \"kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.478230 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.478211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.489900 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.489866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw2td\" (UniqueName: \"kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td\") pod \"payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.576006 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.575964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:17.732322 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:17.732294    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:57:17.734393 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:57:17.734356    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e1d829_b212_4b2b_b527_70601f3a3d57.slice/crio-af27e312f5365efd99e138dbf77c65a96a6f889a586669bac4aed5ca8d1fd1dd WatchSource:0}: Error finding container af27e312f5365efd99e138dbf77c65a96a6f889a586669bac4aed5ca8d1fd1dd: Status 404 returned error can't find the container with id af27e312f5365efd99e138dbf77c65a96a6f889a586669bac4aed5ca8d1fd1dd
Jul 24 14:57:18.641817 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:18.641780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" event={"ID":"05e1d829-b212-4b2b-b527-70601f3a3d57","Type":"ContainerStarted","Data":"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"}
Jul 24 14:57:18.642240 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:18.641830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" event={"ID":"05e1d829-b212-4b2b-b527-70601f3a3d57","Type":"ContainerStarted","Data":"af27e312f5365efd99e138dbf77c65a96a6f889a586669bac4aed5ca8d1fd1dd"}
Jul 24 14:57:18.642240 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:18.641915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:18.662359 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:18.662301    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" podStartSLOduration=1.662285008 podStartE2EDuration="1.662285008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:18.660905769 +0000 UTC m=+2103.048925886" watchObservedRunningTime="2026-07-24 14:57:18.662285008 +0000 UTC m=+2103.050305124"
Jul 24 14:57:20.982979 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:20.982950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:25.811035 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:25.810995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:29.649666 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:29.649632    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:57:52.164244 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.164208    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:57:52.167659 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.167642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.170254 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.170229    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0ac5a605\"/\"kube-root-ca.crt\""
Jul 24 14:57:52.171357 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.171327    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0ac5a605\"/\"openshift-service-ca.crt\""
Jul 24 14:57:52.171491 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.171474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0ac5a605\"/\"default-dockercfg-8wp72\""
Jul 24 14:57:52.171546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.171477    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0ac5a605\"/\"e2e-lifecycle-model-0ac5a605-kserve-self-signed-certs\""
Jul 24 14:57:52.190698 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.190664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:57:52.192272 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.192246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:57:52.316851 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.316811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrnhl\" (UniqueName: \"kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.317027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.316873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.317027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.316968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.317027 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.317020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.317137 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.317063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.317137 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.317085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418451 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrnhl\" (UniqueName: \"kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418451 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418712 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418904 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.418966 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.418905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.419046 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.419020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.421083 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.421063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.421230 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.421210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.428336 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.428315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrnhl\" (UniqueName: \"kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl\") pod \"e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") " pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.477415 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.477374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:57:52.626393 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.626359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:57:52.629340 ip-10-0-132-253 kubenswrapper[2560]: W0724 14:57:52.629309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode649c774_06bc_4a4a_8b1c_4dffd064156b.slice/crio-cdedf2021947b37d79e2397fc925aeeca86a58a1920cf9ef49537fcb2de48e34 WatchSource:0}: Error finding container cdedf2021947b37d79e2397fc925aeeca86a58a1920cf9ef49537fcb2de48e34: Status 404 returned error can't find the container with id cdedf2021947b37d79e2397fc925aeeca86a58a1920cf9ef49537fcb2de48e34
Jul 24 14:57:52.824997 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.824957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" event={"ID":"e649c774-06bc-4a4a-8b1c-4dffd064156b","Type":"ContainerStarted","Data":"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"}
Jul 24 14:57:52.824997 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.825003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" event={"ID":"e649c774-06bc-4a4a-8b1c-4dffd064156b","Type":"ContainerStarted","Data":"cdedf2021947b37d79e2397fc925aeeca86a58a1920cf9ef49537fcb2de48e34"}
Jul 24 14:57:52.853276 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:57:52.853221    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" podStartSLOduration=0.853204871 podStartE2EDuration="853.204871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:57:52.851539872 +0000 UTC m=+2137.239560018" watchObservedRunningTime="2026-07-24 14:57:52.853204871 +0000 UTC m=+2137.241224986"
Jul 24 14:58:02.477976 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:02.477938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:58:02.480526 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:02.477998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:58:02.490663 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:02.490638    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:58:02.886281 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:02.886243    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:58:31.542514 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:31.542480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:32.084211 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.084177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:32.126960 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.126916    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:58:32.127174 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.127148    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" podUID="05e1d829-b212-4b2b-b527-70601f3a3d57" containerName="payload-pre-processing" containerID="cri-o://fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4" gracePeriod=30
Jul 24 14:58:32.186203 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.186160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:32.285956 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.285919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:32.373985 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.373959    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:58:32.505639 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.505605    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw2td\" (UniqueName: \"kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td\") pod \"05e1d829-b212-4b2b-b527-70601f3a3d57\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") "
Jul 24 14:58:32.505828 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.505711    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume\") pod \"05e1d829-b212-4b2b-b527-70601f3a3d57\" (UID: \"05e1d829-b212-4b2b-b527-70601f3a3d57\") "
Jul 24 14:58:32.506076 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.506050    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05e1d829-b212-4b2b-b527-70601f3a3d57" (UID: "05e1d829-b212-4b2b-b527-70601f3a3d57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:58:32.507772 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.507751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td" (OuterVolumeSpecName: "kube-api-access-mw2td") pod "05e1d829-b212-4b2b-b527-70601f3a3d57" (UID: "05e1d829-b212-4b2b-b527-70601f3a3d57"). InnerVolumeSpecName "kube-api-access-mw2td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:58:32.606963 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.606859    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw2td\" (UniqueName: \"kubernetes.io/projected/05e1d829-b212-4b2b-b527-70601f3a3d57-kube-api-access-mw2td\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:58:32.606963 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:32.606905    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1d829-b212-4b2b-b527-70601f3a3d57-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:58:33.023138 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.023042    2560 generic.go:356] "Generic (PLEG): container finished" podID="05e1d829-b212-4b2b-b527-70601f3a3d57" containerID="fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4" exitCode=0
Jul 24 14:58:33.023138 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.023099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"
Jul 24 14:58:33.023323 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.023137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" event={"ID":"05e1d829-b212-4b2b-b527-70601f3a3d57","Type":"ContainerDied","Data":"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"}
Jul 24 14:58:33.023323 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.023217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46" event={"ID":"05e1d829-b212-4b2b-b527-70601f3a3d57","Type":"ContainerDied","Data":"af27e312f5365efd99e138dbf77c65a96a6f889a586669bac4aed5ca8d1fd1dd"}
Jul 24 14:58:33.023323 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.023239    2560 scope.go:117] "RemoveContainer" containerID="fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"
Jul 24 14:58:33.032482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.032462    2560 scope.go:117] "RemoveContainer" containerID="fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"
Jul 24 14:58:33.032797 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:58:33.032774    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4\": container with ID starting with fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4 not found: ID does not exist" containerID="fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"
Jul 24 14:58:33.032871 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.032805    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4"} err="failed to get container status \"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4\": rpc error: code = NotFound desc = could not find container \"fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4\": container with ID starting with fb1d5d8b40a4da013ddead28f8d57190824ae68bae1b0738e071503de7ee52f4 not found: ID does not exist"
Jul 24 14:58:33.046546 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.046519    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:58:33.051249 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:33.051221    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0ac5a605-57d7b87b96-7lp46"]
Jul 24 14:58:34.189340 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:34.189304    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e1d829-b212-4b2b-b527-70601f3a3d57" path="/var/lib/kubelet/pods/05e1d829-b212-4b2b-b527-70601f3a3d57/volumes"
Jul 24 14:58:36.453990 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:36.453955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:40.036482 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:40.036424    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:58:45.125016 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:45.124979    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:58:45.221340 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:58:45.221302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:00.144894 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.144847    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" podUID="e649c774-06bc-4a4a-8b1c-4dffd064156b" containerName="main" containerID="cri-o://0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4" gracePeriod=45
Jul 24 14:59:00.395462 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.395397    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:59:00.479631 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479595    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.479794 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.479794 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479686    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.479794 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrnhl\" (UniqueName: \"kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.479947 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.479947 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache\") pod \"e649c774-06bc-4a4a-8b1c-4dffd064156b\" (UID: \"e649c774-06bc-4a4a-8b1c-4dffd064156b\") "
Jul 24 14:59:00.480056 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.479945    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home" (OuterVolumeSpecName: "home") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:00.480113 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.480093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:00.480270 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.480249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache" (OuterVolumeSpecName: "model-cache") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:00.480345 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.480298    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:00.480345 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.480320    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:00.482208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.482178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl" (OuterVolumeSpecName: "kube-api-access-rrnhl") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "kube-api-access-rrnhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:59:00.482208 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.482183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:59:00.482355 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.482226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm" (OuterVolumeSpecName: "dshm") pod "e649c774-06bc-4a4a-8b1c-4dffd064156b" (UID: "e649c774-06bc-4a4a-8b1c-4dffd064156b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:59:00.581792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.581756    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e649c774-06bc-4a4a-8b1c-4dffd064156b-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:00.581792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.581782    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:00.581792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.581791    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrnhl\" (UniqueName: \"kubernetes.io/projected/e649c774-06bc-4a4a-8b1c-4dffd064156b-kube-api-access-rrnhl\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:00.581792 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:00.581801    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e649c774-06bc-4a4a-8b1c-4dffd064156b-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 14:59:01.168454 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.168407    2560 generic.go:356] "Generic (PLEG): container finished" podID="e649c774-06bc-4a4a-8b1c-4dffd064156b" containerID="0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4" exitCode=0
Jul 24 14:59:01.168454 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.168450    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"
Jul 24 14:59:01.169010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.168486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" event={"ID":"e649c774-06bc-4a4a-8b1c-4dffd064156b","Type":"ContainerDied","Data":"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"}
Jul 24 14:59:01.169010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.168526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr" event={"ID":"e649c774-06bc-4a4a-8b1c-4dffd064156b","Type":"ContainerDied","Data":"cdedf2021947b37d79e2397fc925aeeca86a58a1920cf9ef49537fcb2de48e34"}
Jul 24 14:59:01.169010 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.168543    2560 scope.go:117] "RemoveContainer" containerID="0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"
Jul 24 14:59:01.177860 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.177841    2560 scope.go:117] "RemoveContainer" containerID="0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"
Jul 24 14:59:01.178119 ip-10-0-132-253 kubenswrapper[2560]: E0724 14:59:01.178098    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4\": container with ID starting with 0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4 not found: ID does not exist" containerID="0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"
Jul 24 14:59:01.178187 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.178126    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4"} err="failed to get container status \"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4\": rpc error: code = NotFound desc = could not find container \"0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4\": container with ID starting with 0076cbb40f695402998515a4080ef82cdd9ab392ccd92fa2f8e8206bba5257f4 not found: ID does not exist"
Jul 24 14:59:01.196299 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.196269    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:59:01.203339 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:01.203309    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0ac5a605/e2e-lifecycle-model-0ac5a605-kserve-67ddbd979-vlwmr"]
Jul 24 14:59:02.195195 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:02.195159    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e649c774-06bc-4a4a-8b1c-4dffd064156b" path="/var/lib/kubelet/pods/e649c774-06bc-4a4a-8b1c-4dffd064156b/volumes"
Jul 24 14:59:22.229745 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:22.229704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:23.358310 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:23.358275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:29.637206 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:29.637168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:29.745068 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:29.745017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:29.951550 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:29.951455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:30.185545 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:30.185512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:31.296296 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:31.296260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:31.396049 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:31.396014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:31.499105 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:31.499073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:32.332688 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:32.332652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:32.435957 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:32.435926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:32.548156 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:32.548104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:34.091777 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:34.091715    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:40.760843 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:40.760767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:40.861128 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:40.861095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:41.507617 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:41.507545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:48.323197 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:48.323154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:48.426572 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:48.426523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:48.525498 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:48.525452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:59.138025 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:59.137985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 14:59:59.615951 ip-10-0-132-253 kubenswrapper[2560]: I0724 14:59:59.615919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:20.564889 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:20.564838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:27.853200 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:27.853155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:27.916362 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:27.916325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:28.240465 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:28.240382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:28.583695 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:28.583606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:28.679483 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:28.679442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:31.502743 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:31.502707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:31.589099 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:31.589056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:31.683143 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:31.683106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:31.793817 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:31.793737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:32.213744 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.213708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:32.314769 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.314734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:32.414467 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.414431    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:00:32.414908 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.414889    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e1d829-b212-4b2b-b527-70601f3a3d57" containerName="payload-pre-processing"
Jul 24 15:00:32.415001 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.414910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e1d829-b212-4b2b-b527-70601f3a3d57" containerName="payload-pre-processing"
Jul 24 15:00:32.415001 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.414932    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e649c774-06bc-4a4a-8b1c-4dffd064156b" containerName="main"
Jul 24 15:00:32.415001 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.414940    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e649c774-06bc-4a4a-8b1c-4dffd064156b" containerName="main"
Jul 24 15:00:32.415161 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.415064    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e649c774-06bc-4a4a-8b1c-4dffd064156b" containerName="main"
Jul 24 15:00:32.415161 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.415078    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e1d829-b212-4b2b-b527-70601f3a3d57" containerName="payload-pre-processing"
Jul 24 15:00:32.418395 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.418372    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.421549 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.421509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-51d655-dockercfg-dsz7j\""
Jul 24 15:00:32.421549 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.421530    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-51d655\""
Jul 24 15:00:32.430360 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.430335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:00:32.471632 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.471525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdpkz\" (UniqueName: \"kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.471788 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.471649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.572662 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.572626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.573073 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.572735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdpkz\" (UniqueName: \"kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.573427 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.573409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.584070 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.584048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdpkz\" (UniqueName: \"kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz\") pod \"payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.729406 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.729322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:32.869987 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:32.869955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:00:32.873428 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:00:32.873398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad777ecf_3c6f_42ff_b4bb_d0d48e64501d.slice/crio-e9a22c3b1560751d5261bdeb4edfee9a62034df95d6323a0ddefb31a8b98b3ee WatchSource:0}: Error finding container e9a22c3b1560751d5261bdeb4edfee9a62034df95d6323a0ddefb31a8b98b3ee: Status 404 returned error can't find the container with id e9a22c3b1560751d5261bdeb4edfee9a62034df95d6323a0ddefb31a8b98b3ee
Jul 24 15:00:33.620541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:33.620499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" event={"ID":"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d","Type":"ContainerStarted","Data":"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"}
Jul 24 15:00:33.620541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:33.620549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" event={"ID":"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d","Type":"ContainerStarted","Data":"e9a22c3b1560751d5261bdeb4edfee9a62034df95d6323a0ddefb31a8b98b3ee"}
Jul 24 15:00:33.621003 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:33.620642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:33.642960 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:33.642907    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" podStartSLOduration=1.642891345 podStartE2EDuration="1.642891345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:33.641520117 +0000 UTC m=+2298.029540231" watchObservedRunningTime="2026-07-24 15:00:33.642891345 +0000 UTC m=+2298.030911494"
Jul 24 15:00:36.055733 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:36.055695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:36.430131 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:36.430080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:36.793201 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:36.793113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:37.061626 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:37.061516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:39.483299 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:39.483269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:39.587032 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:39.586995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:39.810321 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:39.810232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:39.928049 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:39.928016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:40.414403 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:40.414372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:40.509725 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:40.509690    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:44.029868 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:44.029828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:44.626842 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:44.626813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:00:47.916169 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:47.916130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:47.989414 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:47.989369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:51.752779 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.752727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:00:51.756424 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.756404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.759624 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.759602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-51d655\"/\"openshift-service-ca.crt\""
Jul 24 15:00:51.760850 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.760828    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-51d655\"/\"default-dockercfg-b9nfg\""
Jul 24 15:00:51.760973 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.760828    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-51d655\"/\"test-model-51d655-kserve-self-signed-certs\""
Jul 24 15:00:51.760973 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.760871    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-51d655\"/\"kube-root-ca.crt\""
Jul 24 15:00:51.770126 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.770098    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:00:51.783043 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.783019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:00:51.855305 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.855305 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.855521 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.855521 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4vd\" (UniqueName: \"kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.855626 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.855626 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.855543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956538 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956544    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.956727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4vd\" (UniqueName: \"kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.957076 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.957045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.957210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.957129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.957210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.957187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.959133 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.959113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.959372 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.959358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:51.967780 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:51.967748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4vd\" (UniqueName: \"kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd\") pod \"test-model-51d655-kserve-8464fddd5-l5cfk\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") " pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:52.065695 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:52.065595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:00:52.210226 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:52.210178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:00:52.720749 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:52.720712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" event={"ID":"8c35f4c5-240d-4b44-b5cf-2e9becb06c66","Type":"ContainerStarted","Data":"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"}
Jul 24 15:00:52.720749 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:52.720752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" event={"ID":"8c35f4c5-240d-4b44-b5cf-2e9becb06c66","Type":"ContainerStarted","Data":"7304c059130ac0b3b04db419734a82f271408d1a9ae9b541e03c568a0ab1603a"}
Jul 24 15:00:52.744356 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:00:52.744295    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" podStartSLOduration=1.744277676 podStartE2EDuration="1.744277676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:52.741791359 +0000 UTC m=+2317.129811475" watchObservedRunningTime="2026-07-24 15:00:52.744277676 +0000 UTC m=+2317.132297799"
Jul 24 15:01:02.066771 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:02.066730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:01:02.067172 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:02.066787    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:01:02.079548 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:02.079515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:01:02.781281 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:02.781251    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:01:25.428304 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.428272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:01:25.431980 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.431957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.438608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.438528    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba2a78\"/\"kube-root-ca.crt\""
Jul 24 15:01:25.438608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.438547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba2a78\"/\"test-model-ba2a78-kserve-self-signed-certs\""
Jul 24 15:01:25.438756 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.438677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba2a78\"/\"openshift-service-ca.crt\""
Jul 24 15:01:25.438849 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.438826    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba2a78\"/\"default-dockercfg-hvx74\""
Jul 24 15:01:25.452108 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.452079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:01:25.481699 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdsg\" (UniqueName: \"kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.481875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.481875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.481875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.481875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.482017 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.481941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.563811 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.563774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:01:25.582996 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.582955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.582996 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583255 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583255 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583255 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdsg\" (UniqueName: \"kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583255 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583474 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583474 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.583589 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.583546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.585405 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.585382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.585769 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.585751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.594336 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.594314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdsg\" (UniqueName: \"kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg\") pod \"test-model-ba2a78-kserve-58f69b9cbc-gwlql\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") " pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.741942 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.741840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:25.890909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:25.890881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:01:25.893662 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:01:25.893630    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2667d53a_be88_4add_b2ab_3f68da19e840.slice/crio-37021c84d871c7db3eba3704038d06f7680134c44077a4b1b384d6daaf7a2c6b WatchSource:0}: Error finding container 37021c84d871c7db3eba3704038d06f7680134c44077a4b1b384d6daaf7a2c6b: Status 404 returned error can't find the container with id 37021c84d871c7db3eba3704038d06f7680134c44077a4b1b384d6daaf7a2c6b
Jul 24 15:01:26.889584 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:26.889525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" event={"ID":"2667d53a-be88-4add-b2ab-3f68da19e840","Type":"ContainerStarted","Data":"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"}
Jul 24 15:01:26.890031 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:26.889597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" event={"ID":"2667d53a-be88-4add-b2ab-3f68da19e840","Type":"ContainerStarted","Data":"37021c84d871c7db3eba3704038d06f7680134c44077a4b1b384d6daaf7a2c6b"}
Jul 24 15:01:26.913808 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:26.913759    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" podStartSLOduration=1.913742596 podStartE2EDuration="1.913742596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:01:26.91275094 +0000 UTC m=+2351.300771056" watchObservedRunningTime="2026-07-24 15:01:26.913742596 +0000 UTC m=+2351.301762712"
Jul 24 15:01:35.742299 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:35.742241    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:35.742873 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:35.742319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:35.754666 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:35.754629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:01:35.947456 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:01:35.947422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:02:07.141376 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:07.141308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:07.234773 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:07.234741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:09.278864 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:09.278828    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:02:09.316417 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:09.316375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:10.349313 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:10.349276    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:02:11.703692 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:11.703655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:21.170669 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.170633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:21.208258 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.208222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:02:21.209119 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.208519    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" podUID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" containerName="payload-pre-processing" containerID="cri-o://7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6" gracePeriod=30
Jul 24 15:02:21.272868 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.272831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:21.373662 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.373624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:21.460412 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.460389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:02:21.534718 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.534685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume\") pod \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") "
Jul 24 15:02:21.534923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.534759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdpkz\" (UniqueName: \"kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz\") pod \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\" (UID: \"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d\") "
Jul 24 15:02:21.535090 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.535066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" (UID: "ad777ecf-3c6f-42ff-b4bb-d0d48e64501d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:02:21.536946 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.536916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz" (OuterVolumeSpecName: "kube-api-access-zdpkz") pod "ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" (UID: "ad777ecf-3c6f-42ff-b4bb-d0d48e64501d"). InnerVolumeSpecName "kube-api-access-zdpkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:21.635839 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.635798    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:21.635839 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:21.635832    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdpkz\" (UniqueName: \"kubernetes.io/projected/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d-kube-api-access-zdpkz\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:22.168714 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.168675    2560 generic.go:356] "Generic (PLEG): container finished" podID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" containerID="7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6" exitCode=0
Jul 24 15:02:22.168890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.168724    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"
Jul 24 15:02:22.168890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.168762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" event={"ID":"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d","Type":"ContainerDied","Data":"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"}
Jul 24 15:02:22.168890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.168821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82" event={"ID":"ad777ecf-3c6f-42ff-b4bb-d0d48e64501d","Type":"ContainerDied","Data":"e9a22c3b1560751d5261bdeb4edfee9a62034df95d6323a0ddefb31a8b98b3ee"}
Jul 24 15:02:22.168890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.168843    2560 scope.go:117] "RemoveContainer" containerID="7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"
Jul 24 15:02:22.178344 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.178325    2560 scope.go:117] "RemoveContainer" containerID="7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"
Jul 24 15:02:22.178694 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:02:22.178616    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6\": container with ID starting with 7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6 not found: ID does not exist" containerID="7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"
Jul 24 15:02:22.178694 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.178643    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6"} err="failed to get container status \"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6\": rpc error: code = NotFound desc = could not find container \"7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6\": container with ID starting with 7bcac0613e9d777fad850ec8b602ad065304d843e18cb4e2b0d0ba01274761d6 not found: ID does not exist"
Jul 24 15:02:22.191253 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.191229    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:02:22.197254 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:22.197230    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-51d655-776d9c568d-wfj82"]
Jul 24 15:02:24.189548 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.189497    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" path="/var/lib/kubelet/pods/ad777ecf-3c6f-42ff-b4bb-d0d48e64501d/volumes"
Jul 24 15:02:24.298429 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.298382    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" podUID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" containerName="main" containerID="cri-o://f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6" gracePeriod=45
Jul 24 15:02:24.549910 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.549886    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:02:24.667134 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667134 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667363 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667196    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667363 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667232    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667363 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667363 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl4vd\" (UniqueName: \"kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd\") pod \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\" (UID: \"8c35f4c5-240d-4b44-b5cf-2e9becb06c66\") "
Jul 24 15:02:24.667614 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:24.667614 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667457    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home" (OuterVolumeSpecName: "home") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:24.667614 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:24.667775 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667672    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:24.667775 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667688    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:24.667775 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.667697    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:24.669681 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.669654    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd" (OuterVolumeSpecName: "kube-api-access-dl4vd") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "kube-api-access-dl4vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:24.669776 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.669682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm" (OuterVolumeSpecName: "dshm") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:24.669776 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.669732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c35f4c5-240d-4b44-b5cf-2e9becb06c66" (UID: "8c35f4c5-240d-4b44-b5cf-2e9becb06c66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:02:24.768612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.768496    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:24.768612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.768526    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:24.768612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:24.768536    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl4vd\" (UniqueName: \"kubernetes.io/projected/8c35f4c5-240d-4b44-b5cf-2e9becb06c66-kube-api-access-dl4vd\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.187167 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.187135    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" containerID="f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6" exitCode=0
Jul 24 15:02:25.187345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.187174    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"
Jul 24 15:02:25.187345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.187202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" event={"ID":"8c35f4c5-240d-4b44-b5cf-2e9becb06c66","Type":"ContainerDied","Data":"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"}
Jul 24 15:02:25.187345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.187232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk" event={"ID":"8c35f4c5-240d-4b44-b5cf-2e9becb06c66","Type":"ContainerDied","Data":"7304c059130ac0b3b04db419734a82f271408d1a9ae9b541e03c568a0ab1603a"}
Jul 24 15:02:25.187345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.187249    2560 scope.go:117] "RemoveContainer" containerID="f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"
Jul 24 15:02:25.199140 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.199118    2560 scope.go:117] "RemoveContainer" containerID="f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"
Jul 24 15:02:25.199433 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:02:25.199407    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6\": container with ID starting with f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6 not found: ID does not exist" containerID="f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"
Jul 24 15:02:25.199479 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.199435    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6"} err="failed to get container status \"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6\": rpc error: code = NotFound desc = could not find container \"f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6\": container with ID starting with f04abbd3f9cf7b90cc272fbdeb4f3e729f2cde7949419b55b75706856311e7c6 not found: ID does not exist"
Jul 24 15:02:25.212325 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.212299    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:02:25.217502 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.217473    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-51d655/test-model-51d655-kserve-8464fddd5-l5cfk"]
Jul 24 15:02:25.369299 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.369260    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" podUID="2667d53a-be88-4add-b2ab-3f68da19e840" containerName="main" containerID="cri-o://ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353" gracePeriod=45
Jul 24 15:02:25.609124 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.609090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:25.617438 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.617414    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:02:25.677992 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.677942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.677992 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.677990    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.678231 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.678231 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678083    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.678231 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.678231 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqdsg\" (UniqueName: \"kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg\") pod \"2667d53a-be88-4add-b2ab-3f68da19e840\" (UID: \"2667d53a-be88-4add-b2ab-3f68da19e840\") "
Jul 24 15:02:25.678439 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678255    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache" (OuterVolumeSpecName: "model-cache") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:25.678439 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678320    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home" (OuterVolumeSpecName: "home") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:25.678439 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:25.678612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678495    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.678612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678513    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.678612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.678527    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.680523 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.680499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm" (OuterVolumeSpecName: "dshm") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:02:25.680666 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.680550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:02:25.680666 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.680587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg" (OuterVolumeSpecName: "kube-api-access-gqdsg") pod "2667d53a-be88-4add-b2ab-3f68da19e840" (UID: "2667d53a-be88-4add-b2ab-3f68da19e840"). InnerVolumeSpecName "kube-api-access-gqdsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:02:25.779062 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.778976    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqdsg\" (UniqueName: \"kubernetes.io/projected/2667d53a-be88-4add-b2ab-3f68da19e840-kube-api-access-gqdsg\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.779062 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.779007    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2667d53a-be88-4add-b2ab-3f68da19e840-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:25.779062 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:25.779017    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2667d53a-be88-4add-b2ab-3f68da19e840-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:02:26.058027 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.057932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:26.191485 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.191451    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" path="/var/lib/kubelet/pods/8c35f4c5-240d-4b44-b5cf-2e9becb06c66/volumes"
Jul 24 15:02:26.193706 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.193679    2560 generic.go:356] "Generic (PLEG): container finished" podID="2667d53a-be88-4add-b2ab-3f68da19e840" containerID="ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353" exitCode=0
Jul 24 15:02:26.193852 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.193727    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"
Jul 24 15:02:26.193852 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.193758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" event={"ID":"2667d53a-be88-4add-b2ab-3f68da19e840","Type":"ContainerDied","Data":"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"}
Jul 24 15:02:26.193852 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.193790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql" event={"ID":"2667d53a-be88-4add-b2ab-3f68da19e840","Type":"ContainerDied","Data":"37021c84d871c7db3eba3704038d06f7680134c44077a4b1b384d6daaf7a2c6b"}
Jul 24 15:02:26.193852 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.193808    2560 scope.go:117] "RemoveContainer" containerID="ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"
Jul 24 15:02:26.202860 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.202840    2560 scope.go:117] "RemoveContainer" containerID="ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"
Jul 24 15:02:26.203166 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:02:26.203106    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353\": container with ID starting with ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353 not found: ID does not exist" containerID="ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"
Jul 24 15:02:26.203166 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.203134    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353"} err="failed to get container status \"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353\": rpc error: code = NotFound desc = could not find container \"ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353\": container with ID starting with ddc483adee2faef2d3139e6b0667ec6d4311b15099382920589d0dd57af47353 not found: ID does not exist"
Jul 24 15:02:26.217529 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.217498    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:02:26.224550 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:26.224527    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ba2a78/test-model-ba2a78-kserve-58f69b9cbc-gwlql"]
Jul 24 15:02:28.189240 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:28.189204    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2667d53a-be88-4add-b2ab-3f68da19e840" path="/var/lib/kubelet/pods/2667d53a-be88-4add-b2ab-3f68da19e840/volumes"
Jul 24 15:02:33.992525 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:33.992491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:34.126058 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:34.126023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:34.285722 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:34.285626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:34.428752 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:34.428716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:34.616536 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:34.616493    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:45.391864 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:45.391768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:45.473761 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:45.473722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:45.551729 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:45.551696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:49.838165 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:49.838124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:50.270176 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:50.270145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:57.513830 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:57.513798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:57.578438 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:57.578409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:57.780435 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:57.780353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:58.030805 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:58.030723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:58.415682 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:58.415650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:58.774897 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:58.774813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:02:58.960719 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:02:58.960682    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:02.407623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:02.407587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:02.563019 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:02.562912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:02.668146 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:02.668059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:03.380161 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:03.380128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:03.555715 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:03.555683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:06.909964 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:06.909933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:07.464112 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:07.464076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:07.814944 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:07.814849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:07.975150 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:07.975114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:10.602584 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:10.602524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:10.701391 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:10.701355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:10.871307 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:10.871222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:11.061126 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.061092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:11.488765 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.488733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:11.592131 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.592097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:11.702369 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702333    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702738    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" containerName="payload-pre-processing"
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702750    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" containerName="payload-pre-processing"
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702768    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2667d53a-be88-4add-b2ab-3f68da19e840" containerName="main"
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702775    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2667d53a-be88-4add-b2ab-3f68da19e840" containerName="main"
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702783    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" containerName="main"
Jul 24 15:03:11.702787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702789    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" containerName="main"
Jul 24 15:03:11.702972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702846    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad777ecf-3c6f-42ff-b4bb-d0d48e64501d" containerName="payload-pre-processing"
Jul 24 15:03:11.702972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702857    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2667d53a-be88-4add-b2ab-3f68da19e840" containerName="main"
Jul 24 15:03:11.702972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.702865    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c35f4c5-240d-4b44-b5cf-2e9becb06c66" containerName="main"
Jul 24 15:03:11.705770 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.705753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.708551 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.708517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a1a404-dockercfg-czrhz\""
Jul 24 15:03:11.708551 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.708535    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a1a404\""
Jul 24 15:03:11.715015 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.714988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:03:11.835915 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.835817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.835915 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.835894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pz79\" (UniqueName: \"kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.937412 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.937371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.937618 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.937436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pz79\" (UniqueName: \"kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.938107 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.938086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:11.949354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:11.949323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pz79\" (UniqueName: \"kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79\") pod \"payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:12.017327 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.017269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:12.169390 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.169364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:03:12.172128 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:03:12.172092    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6ff388_bc48_4c2d_b54a_37c94d439180.slice/crio-ef1814916ee1934b34767ee5e5807cb710fb174c958d7993154648184779f508 WatchSource:0}: Error finding container ef1814916ee1934b34767ee5e5807cb710fb174c958d7993154648184779f508: Status 404 returned error can't find the container with id ef1814916ee1934b34767ee5e5807cb710fb174c958d7993154648184779f508
Jul 24 15:03:12.415920 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.415815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" event={"ID":"ef6ff388-bc48-4c2d-b54a-37c94d439180","Type":"ContainerStarted","Data":"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"}
Jul 24 15:03:12.415920 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.415875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" event={"ID":"ef6ff388-bc48-4c2d-b54a-37c94d439180","Type":"ContainerStarted","Data":"ef1814916ee1934b34767ee5e5807cb710fb174c958d7993154648184779f508"}
Jul 24 15:03:12.416129 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.415947    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:12.442074 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:12.442018    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" podStartSLOduration=1.44200092 podStartE2EDuration="1.44200092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:12.440255723 +0000 UTC m=+2456.828275839" watchObservedRunningTime="2026-07-24 15:03:12.44200092 +0000 UTC m=+2456.830021035"
Jul 24 15:03:15.044365 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:15.044329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:22.800182 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:22.800149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:23.423315 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:23.423283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:03:38.592597 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:38.592538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:38.733288 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:38.733255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:43.591102 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:43.591068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:43.977592 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:43.977474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:51.299971 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:51.299939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:51.407612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:51.407511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:51.603322 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:51.603290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:03:51.989116 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:03:51.989032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:07.771659 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:07.771548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:07.819625 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:07.819588    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:04:07.819886 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:07.819849    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" podUID="ef6ff388-bc48-4c2d-b54a-37c94d439180" containerName="payload-pre-processing" containerID="cri-o://0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5" gracePeriod=30
Jul 24 15:04:07.854659 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:07.854627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:07.955704 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:07.955668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:08.073807 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.073782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:04:08.099543 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.099514    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pz79\" (UniqueName: \"kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79\") pod \"ef6ff388-bc48-4c2d-b54a-37c94d439180\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") "
Jul 24 15:04:08.099710 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.099604    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume\") pod \"ef6ff388-bc48-4c2d-b54a-37c94d439180\" (UID: \"ef6ff388-bc48-4c2d-b54a-37c94d439180\") "
Jul 24 15:04:08.099972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.099951    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef6ff388-bc48-4c2d-b54a-37c94d439180" (UID: "ef6ff388-bc48-4c2d-b54a-37c94d439180"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:04:08.101849 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.101823    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79" (OuterVolumeSpecName: "kube-api-access-9pz79") pod "ef6ff388-bc48-4c2d-b54a-37c94d439180" (UID: "ef6ff388-bc48-4c2d-b54a-37c94d439180"). InnerVolumeSpecName "kube-api-access-9pz79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:04:08.200418 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.200394    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pz79\" (UniqueName: \"kubernetes.io/projected/ef6ff388-bc48-4c2d-b54a-37c94d439180-kube-api-access-9pz79\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.200499 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.200420    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6ff388-bc48-4c2d-b54a-37c94d439180-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:04:08.697449 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.697412    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef6ff388-bc48-4c2d-b54a-37c94d439180" containerID="0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5" exitCode=0
Jul 24 15:04:08.697687 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.697463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"
Jul 24 15:04:08.697687 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.697476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" event={"ID":"ef6ff388-bc48-4c2d-b54a-37c94d439180","Type":"ContainerDied","Data":"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"}
Jul 24 15:04:08.697687 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.697523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf" event={"ID":"ef6ff388-bc48-4c2d-b54a-37c94d439180","Type":"ContainerDied","Data":"ef1814916ee1934b34767ee5e5807cb710fb174c958d7993154648184779f508"}
Jul 24 15:04:08.697687 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.697547    2560 scope.go:117] "RemoveContainer" containerID="0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"
Jul 24 15:04:08.706572 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.706534    2560 scope.go:117] "RemoveContainer" containerID="0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"
Jul 24 15:04:08.706864 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:04:08.706844    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5\": container with ID starting with 0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5 not found: ID does not exist" containerID="0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"
Jul 24 15:04:08.706948 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.706871    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5"} err="failed to get container status \"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5\": rpc error: code = NotFound desc = could not find container \"0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5\": container with ID starting with 0b6d4ac470e8725d514095b85ba53c89e1f399d426fcf94ed84221fa90dff4e5 not found: ID does not exist"
Jul 24 15:04:08.716962 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.716932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:04:08.726745 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:08.726704    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a1a404-599fdcd9dd-qdhkf"]
Jul 24 15:04:10.189543 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:10.189510    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6ff388-bc48-4c2d-b54a-37c94d439180" path="/var/lib/kubelet/pods/ef6ff388-bc48-4c2d-b54a-37c94d439180/volumes"
Jul 24 15:04:12.228954 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:12.228921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:12.591443 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:12.591410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:18.948402 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:18.948362    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:19.283598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:19.283492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:19.383582 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:19.383522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:19.518730 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:19.518676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:19.917800 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:19.917770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:20.293962 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:20.293876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:20.871086 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:20.871052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:23.898136 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:23.898096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:24.024176 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:24.024142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:24.135883 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:24.135845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:24.352210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:24.352175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:24.728596 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:24.728491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:24.823326 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:24.823296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:28.480803 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:28.480772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:28.842278 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:28.842244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:29.182687 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:29.182598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:29.405233 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:29.405195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:31.871096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:31.871050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:31.970733 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:31.970702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:32.160188 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.160090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:32.619391 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.619351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:32.719489 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.719460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:32.810871 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.810841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:32.862764 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.862715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:04:32.863161 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.863147    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6ff388-bc48-4c2d-b54a-37c94d439180" containerName="payload-pre-processing"
Jul 24 15:04:32.863210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.863163    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6ff388-bc48-4c2d-b54a-37c94d439180" containerName="payload-pre-processing"
Jul 24 15:04:32.863248 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.863232    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef6ff388-bc48-4c2d-b54a-37c94d439180" containerName="payload-pre-processing"
Jul 24 15:04:32.866362 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.866344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:32.868689 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.868664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-0d170b\""
Jul 24 15:04:32.868800 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.868754    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-0d170b-dockercfg-bvktk\""
Jul 24 15:04:32.876165 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.876139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:04:32.957891 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.957855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:32.957891 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:32.957895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m4pc\" (UniqueName: \"kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.058619 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.058585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.058619 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.058627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m4pc\" (UniqueName: \"kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.059311 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.059288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.068090 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.068057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m4pc\" (UniqueName: \"kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc\") pod \"payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.178278 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.178187    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.329649 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.329620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:04:33.334695 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:04:33.334660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a03891_fc7e_4e4b_9d68_90e22adebd02.slice/crio-12b23a5b807309c9315519f287af2c7add608b53473b4eab1c45f22a5089d73c WatchSource:0}: Error finding container 12b23a5b807309c9315519f287af2c7add608b53473b4eab1c45f22a5089d73c: Status 404 returned error can't find the container with id 12b23a5b807309c9315519f287af2c7add608b53473b4eab1c45f22a5089d73c
Jul 24 15:04:33.818920 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.818882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" event={"ID":"41a03891-fc7e-4e4b-9d68-90e22adebd02","Type":"ContainerStarted","Data":"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"}
Jul 24 15:04:33.819141 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.818939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" event={"ID":"41a03891-fc7e-4e4b-9d68-90e22adebd02","Type":"ContainerStarted","Data":"12b23a5b807309c9315519f287af2c7add608b53473b4eab1c45f22a5089d73c"}
Jul 24 15:04:33.819141 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.818960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:33.837506 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:33.837453    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" podStartSLOduration=1.837438572 podStartE2EDuration="1.837438572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:33.836124127 +0000 UTC m=+2538.224144245" watchObservedRunningTime="2026-07-24 15:04:33.837438572 +0000 UTC m=+2538.225458688"
Jul 24 15:04:36.419716 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:36.419674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:44.826894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:44.826857    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:04:56.852488 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.852444    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:04:56.856318 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.856294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.858951 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.858925    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"openshift-service-ca.crt\""
Jul 24 15:04:56.860028 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.860002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"kube-root-ca.crt\""
Jul 24 15:04:56.860028 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.860026    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"default-dockercfg-rrzcq\""
Jul 24 15:04:56.860203 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.860123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"auth-test-model-876f50-kserve-self-signed-certs\""
Jul 24 15:04:56.865807 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.865785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:04:56.889861 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.889826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:04:56.985362 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.985362 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.985617 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.985617 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.985617 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:56.985740 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:56.985644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfjm\" (UniqueName: \"kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.086949 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.086907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfjm\" (UniqueName: \"kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087137 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.086980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087137 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087219 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087219 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087296 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087412 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087468 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.087506 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.087462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.089655 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.089628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.089894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.089876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.097512 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.097480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfjm\" (UniqueName: \"kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm\") pod \"auth-test-model-876f50-kserve-d677cc89f-hltnj\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") " pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.167256 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.167166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:04:57.308186 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.308159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:04:57.310172 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:04:57.310139    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4d88105_9455_4ec0_b6ac_545cfe3f2e99.slice/crio-d02e2ee6191d8e4e00777ead4aed1b61facfb7fa1563084e1215161d6b256545 WatchSource:0}: Error finding container d02e2ee6191d8e4e00777ead4aed1b61facfb7fa1563084e1215161d6b256545: Status 404 returned error can't find the container with id d02e2ee6191d8e4e00777ead4aed1b61facfb7fa1563084e1215161d6b256545
Jul 24 15:04:57.941320 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.941281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" event={"ID":"f4d88105-9455-4ec0-b6ac-545cfe3f2e99","Type":"ContainerStarted","Data":"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"}
Jul 24 15:04:57.941764 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.941335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" event={"ID":"f4d88105-9455-4ec0-b6ac-545cfe3f2e99","Type":"ContainerStarted","Data":"d02e2ee6191d8e4e00777ead4aed1b61facfb7fa1563084e1215161d6b256545"}
Jul 24 15:04:57.960931 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:04:57.960876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" podStartSLOduration=1.960861507 podStartE2EDuration="1.960861507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:57.959504195 +0000 UTC m=+2562.347524311" watchObservedRunningTime="2026-07-24 15:04:57.960861507 +0000 UTC m=+2562.348881623"
Jul 24 15:05:07.168192 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:07.168147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:05:07.168693 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:07.168245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:05:07.181864 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:07.181838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:05:08.001497 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:08.001465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:05:38.254365 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.254283    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:05:38.258148 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.258128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.260730 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.260710    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"kube-root-ca.crt\""
Jul 24 15:05:38.261675 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.261644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"openshift-service-ca.crt\""
Jul 24 15:05:38.261829 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.261677    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"default-dockercfg-ts94v\""
Jul 24 15:05:38.261829 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.261738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"auth-test-model-0d170b-kserve-self-signed-certs\""
Jul 24 15:05:38.266789 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.266765    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:05:38.288159 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.288113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:05:38.396723 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6crq\" (UniqueName: \"kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.396723 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.396940 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.396940 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.396940 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.396940 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.396932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498193 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498396 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498396 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498396 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498396 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498396 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6crq\" (UniqueName: \"kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498721 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498721 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.498830 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.498751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.500670 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.500648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.500888 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.500868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.509455 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.509399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6crq\" (UniqueName: \"kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq\") pod \"auth-test-model-0d170b-kserve-7b5c754867-f55tg\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") " pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.568439 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.568399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:38.710603 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:38.710577    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:05:38.712790 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:05:38.712748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef3647f_7ccc_4e9d_8aec_7521299ed28c.slice/crio-28a8506acdeb31a51bb849376a73e0a321c59c4558134e89478d935b60483dd6 WatchSource:0}: Error finding container 28a8506acdeb31a51bb849376a73e0a321c59c4558134e89478d935b60483dd6: Status 404 returned error can't find the container with id 28a8506acdeb31a51bb849376a73e0a321c59c4558134e89478d935b60483dd6
Jul 24 15:05:39.141051 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:39.141012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" event={"ID":"5ef3647f-7ccc-4e9d-8aec-7521299ed28c","Type":"ContainerStarted","Data":"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"}
Jul 24 15:05:39.141051 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:39.141059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" event={"ID":"5ef3647f-7ccc-4e9d-8aec-7521299ed28c","Type":"ContainerStarted","Data":"28a8506acdeb31a51bb849376a73e0a321c59c4558134e89478d935b60483dd6"}
Jul 24 15:05:39.162321 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:39.162268    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" podStartSLOduration=1.162252758 podStartE2EDuration="1.162252758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:05:39.161156472 +0000 UTC m=+2603.549176591" watchObservedRunningTime="2026-07-24 15:05:39.162252758 +0000 UTC m=+2603.550272874"
Jul 24 15:05:48.569400 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:48.569360    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:48.569913 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:48.569589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:48.582254 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:48.582228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:05:49.206099 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:05:49.206063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:07:21.371248 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:21.371162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:07:22.709123 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:22.709085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:07:28.041752 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:28.041717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:07:52.830918 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:52.830881    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:07:52.850308 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:52.850278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:07:53.935928 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:53.935887    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:07:53.956880 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:07:53.956846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:08:05.286301 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:05.286264    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:08:07.850636 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:07.850578    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerName="main" containerID="cri-o://c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4" gracePeriod=45
Jul 24 15:08:07.991328 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:07.991255    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": dial tcp 10.133.0.46:8000: connect: connection refused"
Jul 24 15:08:08.094133 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.094108    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:08:08.224047 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.223949    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224047 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.223991    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224047 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmfjm\" (UniqueName: \"kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache\") pod \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\" (UID: \"f4d88105-9455-4ec0-b6ac-545cfe3f2e99\") "
Jul 24 15:08:08.224345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:08.224598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224369    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home" (OuterVolumeSpecName: "home") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:08.224598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224528    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.224598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224544    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.224598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.224535    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:08.226460 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.226435    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:08:08.226460 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.226450    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm" (OuterVolumeSpecName: "kube-api-access-pmfjm") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "kube-api-access-pmfjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:08:08.226608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.226508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm" (OuterVolumeSpecName: "dshm") pod "f4d88105-9455-4ec0-b6ac-545cfe3f2e99" (UID: "f4d88105-9455-4ec0-b6ac-545cfe3f2e99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:08.325813 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.325778    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmfjm\" (UniqueName: \"kubernetes.io/projected/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-kube-api-access-pmfjm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.325813 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.325808    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.325813 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.325819    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.326057 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.325828    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d88105-9455-4ec0-b6ac-545cfe3f2e99-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:08.888895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.888855    2560 generic.go:356] "Generic (PLEG): container finished" podID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerID="c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4" exitCode=0
Jul 24 15:08:08.888895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.888897    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"
Jul 24 15:08:08.889355 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.888896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" event={"ID":"f4d88105-9455-4ec0-b6ac-545cfe3f2e99","Type":"ContainerDied","Data":"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"}
Jul 24 15:08:08.889355 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.889023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj" event={"ID":"f4d88105-9455-4ec0-b6ac-545cfe3f2e99","Type":"ContainerDied","Data":"d02e2ee6191d8e4e00777ead4aed1b61facfb7fa1563084e1215161d6b256545"}
Jul 24 15:08:08.889355 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.889054    2560 scope.go:117] "RemoveContainer" containerID="c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"
Jul 24 15:08:08.898618 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.898599    2560 scope.go:117] "RemoveContainer" containerID="c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"
Jul 24 15:08:08.898922 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:08:08.898902    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4\": container with ID starting with c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4 not found: ID does not exist" containerID="c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"
Jul 24 15:08:08.898983 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.898932    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4"} err="failed to get container status \"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4\": rpc error: code = NotFound desc = could not find container \"c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4\": container with ID starting with c2b5db35a88afca75a9cea1c77949709ef7f79e737bc1151fb1d502082c355a4 not found: ID does not exist"
Jul 24 15:08:08.913225 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.913195    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:08:08.920498 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.920468    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/auth-test-model-876f50-kserve-d677cc89f-hltnj"]
Jul 24 15:08:08.956147 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:08.956111    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerName="main" containerID="cri-o://8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf" gracePeriod=45
Jul 24 15:08:09.209143 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.209117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:08:09.233933 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.233904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234100 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.233965    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234100 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234024    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234100 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6crq\" (UniqueName: \"kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234274 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234274 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234171    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir\") pod \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\" (UID: \"5ef3647f-7ccc-4e9d-8aec-7521299ed28c\") "
Jul 24 15:08:09.234274 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234253    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:09.235608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:09.235608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.234550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home" (OuterVolumeSpecName: "home") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:09.235608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.235457    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.235608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.235479    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.235608 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.235494    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.236701 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.236682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm" (OuterVolumeSpecName: "dshm") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:08:09.237528 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.237498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq" (OuterVolumeSpecName: "kube-api-access-h6crq") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "kube-api-access-h6crq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:08:09.237739 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.237713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ef3647f-7ccc-4e9d-8aec-7521299ed28c" (UID: "5ef3647f-7ccc-4e9d-8aec-7521299ed28c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:08:09.336649 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.336619    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.336649 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.336645    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6crq\" (UniqueName: \"kubernetes.io/projected/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-kube-api-access-h6crq\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.336649 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.336654    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef3647f-7ccc-4e9d-8aec-7521299ed28c-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:08:09.895108 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.895073    2560 generic.go:356] "Generic (PLEG): container finished" podID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerID="8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf" exitCode=0
Jul 24 15:08:09.895625 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.895117    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"
Jul 24 15:08:09.895625 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.895155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" event={"ID":"5ef3647f-7ccc-4e9d-8aec-7521299ed28c","Type":"ContainerDied","Data":"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"}
Jul 24 15:08:09.895625 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.895204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" event={"ID":"5ef3647f-7ccc-4e9d-8aec-7521299ed28c","Type":"ContainerDied","Data":"28a8506acdeb31a51bb849376a73e0a321c59c4558134e89478d935b60483dd6"}
Jul 24 15:08:09.895625 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.895228    2560 scope.go:117] "RemoveContainer" containerID="8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"
Jul 24 15:08:09.905027 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.905009    2560 scope.go:117] "RemoveContainer" containerID="8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"
Jul 24 15:08:09.905294 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:08:09.905277    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf\": container with ID starting with 8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf not found: ID does not exist" containerID="8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"
Jul 24 15:08:09.905343 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.905302    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf"} err="failed to get container status \"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf\": rpc error: code = NotFound desc = could not find container \"8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf\": container with ID starting with 8108616ea7e2ac03e51dab5aec69da3f7f4feffae43ca664500cbd68e6bb2cbf not found: ID does not exist"
Jul 24 15:08:09.918594 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.918541    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:08:09.926659 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:09.926633    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg"]
Jul 24 15:08:10.189267 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:10.189190    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" path="/var/lib/kubelet/pods/5ef3647f-7ccc-4e9d-8aec-7521299ed28c/volumes"
Jul 24 15:08:10.189591 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:10.189577    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" path="/var/lib/kubelet/pods/f4d88105-9455-4ec0-b6ac-545cfe3f2e99/volumes"
Jul 24 15:08:14.195789 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:14.195748    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-0d170b/auth-test-model-0d170b-kserve-7b5c754867-f55tg" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 24 15:08:32.885419 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885387    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:08:32.885909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885823    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerName="main"
Jul 24 15:08:32.885909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885837    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerName="main"
Jul 24 15:08:32.885909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885859    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerName="main"
Jul 24 15:08:32.885909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885864    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerName="main"
Jul 24 15:08:32.886039 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885928    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef3647f-7ccc-4e9d-8aec-7521299ed28c" containerName="main"
Jul 24 15:08:32.886039 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.885937    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d88105-9455-4ec0-b6ac-545cfe3f2e99" containerName="main"
Jul 24 15:08:32.889208 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.889187    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.899890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.899864    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"openshift-service-ca.crt\""
Jul 24 15:08:32.900877 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.900858    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"sub-test-model-0d170b-kserve-self-signed-certs\""
Jul 24 15:08:32.900972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.900875    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"kube-root-ca.crt\""
Jul 24 15:08:32.900972 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.900907    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"default-dockercfg-ts94v\""
Jul 24 15:08:32.933609 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.933551    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:08:32.956576 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd7ft\" (UniqueName: \"kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.956750 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.956862 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.956862 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.956812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:32.995969 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:32.995937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:08:33.058096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058333 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058333 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd7ft\" (UniqueName: \"kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058436 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058436 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058653 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058753 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.058753 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.058709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.060708 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.060684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.060965 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.060945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.070252 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.070232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd7ft\" (UniqueName: \"kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft\") pod \"sub-test-model-0d170b-kserve-5964994db7-wzmqj\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") " pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.199065 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.198958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:33.338650 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:33.338616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:08:33.341639 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:08:33.341604    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9939a60_e94b_40ed_b230_b42488bca60d.slice/crio-aaebf34617de7f194a455515457c996a5f8a06e6b86d56b4fb1d9d53524ff02f WatchSource:0}: Error finding container aaebf34617de7f194a455515457c996a5f8a06e6b86d56b4fb1d9d53524ff02f: Status 404 returned error can't find the container with id aaebf34617de7f194a455515457c996a5f8a06e6b86d56b4fb1d9d53524ff02f
Jul 24 15:08:34.025570 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:34.025531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" event={"ID":"a9939a60-e94b-40ed-b230-b42488bca60d","Type":"ContainerStarted","Data":"6f866143af2ecb825671f98eec644e5b4b80598ec311f2e52df028cad59c6c8d"}
Jul 24 15:08:34.025980 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:34.025592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" event={"ID":"a9939a60-e94b-40ed-b230-b42488bca60d","Type":"ContainerStarted","Data":"aaebf34617de7f194a455515457c996a5f8a06e6b86d56b4fb1d9d53524ff02f"}
Jul 24 15:08:34.048714 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:34.048658    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" podStartSLOduration=2.048641646 podStartE2EDuration="2.048641646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:08:34.046397817 +0000 UTC m=+2778.434417936" watchObservedRunningTime="2026-07-24 15:08:34.048641646 +0000 UTC m=+2778.436661821"
Jul 24 15:08:43.199895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:43.199813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:43.199895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:43.199866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:43.212121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:43.212086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:08:44.086442 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:08:44.086410    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:09:19.272398 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:19.272365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:09:20.168016 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:20.167982    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:09:20.198500 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:20.198470    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:09:29.566956 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.566919    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:09:29.570316 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.570298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.573369 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.573346    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"kube-root-ca.crt\""
Jul 24 15:09:29.574395 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.574372    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"default-dockercfg-rrzcq\""
Jul 24 15:09:29.574525 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.574503    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"rate-test-model-876f50-kserve-self-signed-certs\""
Jul 24 15:09:29.574622 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.574539    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-876f50\"/\"openshift-service-ca.crt\""
Jul 24 15:09:29.586379 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.586354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:09:29.606601 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.604586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:09:29.622974 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.622940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.623138 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.622980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.623138 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.623003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.623138 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.623074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.623138 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.623108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.623276 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.623142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5t5j\" (UniqueName: \"kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.724894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.724730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5t5j\" (UniqueName: \"kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.725210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.725174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.725285 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.725193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.725285 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.725223    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.727683 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.727661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.727874 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.727856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.735871 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.735846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5t5j\" (UniqueName: \"kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j\") pod \"rate-test-model-876f50-kserve-7764cf5587-vnp7n\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") " pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:29.880772 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:29.880721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:30.021574 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:30.021529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:09:30.024142 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:09:30.024114    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda12459c2_a264_4765_9f22_322555f2a0d1.slice/crio-fb15388d47bbd2d1eded6d5975df7d70f4e786fc12b02635ac20d6d6f8585c2f WatchSource:0}: Error finding container fb15388d47bbd2d1eded6d5975df7d70f4e786fc12b02635ac20d6d6f8585c2f: Status 404 returned error can't find the container with id fb15388d47bbd2d1eded6d5975df7d70f4e786fc12b02635ac20d6d6f8585c2f
Jul 24 15:09:30.306600 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:30.306469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" event={"ID":"a12459c2-a264-4765-9f22-322555f2a0d1","Type":"ContainerStarted","Data":"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"}
Jul 24 15:09:30.306600 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:30.306515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" event={"ID":"a12459c2-a264-4765-9f22-322555f2a0d1","Type":"ContainerStarted","Data":"fb15388d47bbd2d1eded6d5975df7d70f4e786fc12b02635ac20d6d6f8585c2f"}
Jul 24 15:09:30.326077 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:30.326016    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" podStartSLOduration=1.325998784 podStartE2EDuration="1.325998784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:30.324899363 +0000 UTC m=+2834.712919482" watchObservedRunningTime="2026-07-24 15:09:30.325998784 +0000 UTC m=+2834.714018901"
Jul 24 15:09:32.174277 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:32.174242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:09:35.188414 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.188343    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" podUID="a9939a60-e94b-40ed-b230-b42488bca60d" containerName="main" containerID="cri-o://6f866143af2ecb825671f98eec644e5b4b80598ec311f2e52df028cad59c6c8d" gracePeriod=45
Jul 24 15:09:35.333407 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.333373    2560 generic.go:356] "Generic (PLEG): container finished" podID="a9939a60-e94b-40ed-b230-b42488bca60d" containerID="6f866143af2ecb825671f98eec644e5b4b80598ec311f2e52df028cad59c6c8d" exitCode=0
Jul 24 15:09:35.333603 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.333453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" event={"ID":"a9939a60-e94b-40ed-b230-b42488bca60d","Type":"ContainerDied","Data":"6f866143af2ecb825671f98eec644e5b4b80598ec311f2e52df028cad59c6c8d"}
Jul 24 15:09:35.447828 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.447757    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:09:35.484413 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484381    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd7ft\" (UniqueName: \"kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484623 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484849 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484664    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home\") pod \"a9939a60-e94b-40ed-b230-b42488bca60d\" (UID: \"a9939a60-e94b-40ed-b230-b42488bca60d\") "
Jul 24 15:09:35.484930 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:35.484990 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:35.484990 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.484925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home" (OuterVolumeSpecName: "home") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:35.486849 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.486827    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:09:35.487050 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.487026    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft" (OuterVolumeSpecName: "kube-api-access-sd7ft") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "kube-api-access-sd7ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:09:35.487186 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.487171    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm" (OuterVolumeSpecName: "dshm") pod "a9939a60-e94b-40ed-b230-b42488bca60d" (UID: "a9939a60-e94b-40ed-b230-b42488bca60d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:09:35.585870 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585837    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:35.585870 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585865    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:35.585870 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585874    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9939a60-e94b-40ed-b230-b42488bca60d-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:35.586107 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585885    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd7ft\" (UniqueName: \"kubernetes.io/projected/a9939a60-e94b-40ed-b230-b42488bca60d-kube-api-access-sd7ft\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:35.586107 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585893    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:35.586107 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:35.585923    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9939a60-e94b-40ed-b230-b42488bca60d-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:09:36.339960 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:36.339926    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"
Jul 24 15:09:36.340373 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:36.339958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj" event={"ID":"a9939a60-e94b-40ed-b230-b42488bca60d","Type":"ContainerDied","Data":"aaebf34617de7f194a455515457c996a5f8a06e6b86d56b4fb1d9d53524ff02f"}
Jul 24 15:09:36.340373 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:36.340009    2560 scope.go:117] "RemoveContainer" containerID="6f866143af2ecb825671f98eec644e5b4b80598ec311f2e52df028cad59c6c8d"
Jul 24 15:09:36.359447 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:36.359423    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:09:36.363910 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:36.363888    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/sub-test-model-0d170b-kserve-5964994db7-wzmqj"]
Jul 24 15:09:38.189343 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:38.189312    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9939a60-e94b-40ed-b230-b42488bca60d" path="/var/lib/kubelet/pods/a9939a60-e94b-40ed-b230-b42488bca60d/volumes"
Jul 24 15:09:39.881897 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:39.881838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:39.881897 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:39.881910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:39.894868 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:39.894839    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:40.371146 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:40.371107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:09:50.544842 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.544808    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:09:50.545426 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.545256    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9939a60-e94b-40ed-b230-b42488bca60d" containerName="main"
Jul 24 15:09:50.545426 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.545272    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9939a60-e94b-40ed-b230-b42488bca60d" containerName="main"
Jul 24 15:09:50.545426 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.545402    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9939a60-e94b-40ed-b230-b42488bca60d" containerName="main"
Jul 24 15:09:50.549483 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.549462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.552045 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.552009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"openshift-service-ca.crt\""
Jul 24 15:09:50.553146 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.553123    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"kube-root-ca.crt\""
Jul 24 15:09:50.553275 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.553159    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"rate-test-model-0d170b-kserve-self-signed-certs\""
Jul 24 15:09:50.553343 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.553293    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d170b\"/\"default-dockercfg-ts94v\""
Jul 24 15:09:50.559119 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.559096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:09:50.588820 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.588781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:09:50.631320 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.631482 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.631482 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.631573 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfdf\" (UniqueName: \"kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.631618 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.631618 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.631615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732325 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfdf\" (UniqueName: \"kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.732958 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.732920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.734930 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.734908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.735033 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.735016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.746691 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.746663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfdf\" (UniqueName: \"kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf\") pod \"rate-test-model-0d170b-kserve-dd8fccc55-cfd2x\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") " pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:50.860759 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:50.860715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:09:51.001495 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:51.001471    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:09:51.003701 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:09:51.003675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce098147_2f19_43b9_a187_99e4113d05e5.slice/crio-a0af29ced0f1c49ef1053efe91ecbfaa673d80aafde052b6b7224ed0b6ae7fdc WatchSource:0}: Error finding container a0af29ced0f1c49ef1053efe91ecbfaa673d80aafde052b6b7224ed0b6ae7fdc: Status 404 returned error can't find the container with id a0af29ced0f1c49ef1053efe91ecbfaa673d80aafde052b6b7224ed0b6ae7fdc
Jul 24 15:09:51.418021 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:51.417972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" event={"ID":"ce098147-2f19-43b9-a187-99e4113d05e5","Type":"ContainerStarted","Data":"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"}
Jul 24 15:09:51.418021 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:51.418019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" event={"ID":"ce098147-2f19-43b9-a187-99e4113d05e5","Type":"ContainerStarted","Data":"a0af29ced0f1c49ef1053efe91ecbfaa673d80aafde052b6b7224ed0b6ae7fdc"}
Jul 24 15:09:51.438135 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:09:51.438080    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" podStartSLOduration=1.438061439 podStartE2EDuration="1.438061439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:51.436918457 +0000 UTC m=+2855.824938586" watchObservedRunningTime="2026-07-24 15:09:51.438061439 +0000 UTC m=+2855.826081612"
Jul 24 15:10:00.861807 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:00.861763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:00.861807 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:00.861810    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:00.874727 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:00.874695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:01.481574 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:01.481530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:30.347620 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:30.347588    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:10:30.372923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:30.372889    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:31.369392 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:31.369359    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:10:31.384345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:31.384311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:45.367099 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.367029    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" podUID="a12459c2-a264-4765-9f22-322555f2a0d1" containerName="main" containerID="cri-o://53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46" gracePeriod=45
Jul 24 15:10:45.624075 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.624006    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:10:45.686791 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.686759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.686991 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.686805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.686991 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.686846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.686991 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.686896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.686991 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.686925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5t5j\" (UniqueName: \"kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.687213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs\") pod \"a12459c2-a264-4765-9f22-322555f2a0d1\" (UID: \"a12459c2-a264-4765-9f22-322555f2a0d1\") "
Jul 24 15:10:45.687213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:45.687213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687041    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:45.687213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687145    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home" (OuterVolumeSpecName: "home") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:45.687402 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687315    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:45.687402 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687329    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:45.687402 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.687341    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:45.689453 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j" (OuterVolumeSpecName: "kube-api-access-z5t5j") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "kube-api-access-z5t5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:45.689611 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:10:45.689611 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm" (OuterVolumeSpecName: "dshm") pod "a12459c2-a264-4765-9f22-322555f2a0d1" (UID: "a12459c2-a264-4765-9f22-322555f2a0d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:45.689833 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689810    2560 generic.go:356] "Generic (PLEG): container finished" podID="a12459c2-a264-4765-9f22-322555f2a0d1" containerID="53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46" exitCode=0
Jul 24 15:10:45.689904 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689856    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"
Jul 24 15:10:45.689904 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" event={"ID":"a12459c2-a264-4765-9f22-322555f2a0d1","Type":"ContainerDied","Data":"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"}
Jul 24 15:10:45.690006 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n" event={"ID":"a12459c2-a264-4765-9f22-322555f2a0d1","Type":"ContainerDied","Data":"fb15388d47bbd2d1eded6d5975df7d70f4e786fc12b02635ac20d6d6f8585c2f"}
Jul 24 15:10:45.690006 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.689928    2560 scope.go:117] "RemoveContainer" containerID="53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"
Jul 24 15:10:45.710298 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.709941    2560 scope.go:117] "RemoveContainer" containerID="53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"
Jul 24 15:10:45.711602 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:10:45.710512    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46\": container with ID starting with 53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46 not found: ID does not exist" containerID="53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"
Jul 24 15:10:45.711602 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.710596    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46"} err="failed to get container status \"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46\": rpc error: code = NotFound desc = could not find container \"53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46\": container with ID starting with 53ca7044f7c2ba4cbea84e035eb00601f92fa1ced459b4750c82814a3e52eb46 not found: ID does not exist"
Jul 24 15:10:45.723636 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.723607    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:10:45.728648 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.728623    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-876f50/rate-test-model-876f50-kserve-7764cf5587-vnp7n"]
Jul 24 15:10:45.788551 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.788524    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12459c2-a264-4765-9f22-322555f2a0d1-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:45.788551 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.788550    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5t5j\" (UniqueName: \"kubernetes.io/projected/a12459c2-a264-4765-9f22-322555f2a0d1-kube-api-access-z5t5j\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:45.788759 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:45.788584    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12459c2-a264-4765-9f22-322555f2a0d1-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.191416 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.191382    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a12459c2-a264-4765-9f22-322555f2a0d1" path="/var/lib/kubelet/pods/a12459c2-a264-4765-9f22-322555f2a0d1/volumes"
Jul 24 15:10:46.389234 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.389181    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" podUID="ce098147-2f19-43b9-a187-99e4113d05e5" containerName="main" containerID="cri-o://2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e" gracePeriod=45
Jul 24 15:10:46.645675 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.645650    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:46.695666 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695635    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695678    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnfdf\" (UniqueName: \"kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695740    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695767    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695806    2560 generic.go:356] "Generic (PLEG): container finished" podID="ce098147-2f19-43b9-a187-99e4113d05e5" containerID="2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e" exitCode=0
Jul 24 15:10:46.695869 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home\") pod \"ce098147-2f19-43b9-a187-99e4113d05e5\" (UID: \"ce098147-2f19-43b9-a187-99e4113d05e5\") "
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.695995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696044    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" event={"ID":"ce098147-2f19-43b9-a187-99e4113d05e5","Type":"ContainerDied","Data":"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"}
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x" event={"ID":"ce098147-2f19-43b9-a187-99e4113d05e5","Type":"ContainerDied","Data":"a0af29ced0f1c49ef1053efe91ecbfaa673d80aafde052b6b7224ed0b6ae7fdc"}
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696149    2560 scope.go:117] "RemoveContainer" containerID="2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"
Jul 24 15:10:46.696197 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696181    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.696541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696202    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.696541 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.696214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home" (OuterVolumeSpecName: "home") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:46.698365 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.698335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:10:46.698479 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.698385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf" (OuterVolumeSpecName: "kube-api-access-jnfdf") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "kube-api-access-jnfdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:10:46.699096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.698487    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm" (OuterVolumeSpecName: "dshm") pod "ce098147-2f19-43b9-a187-99e4113d05e5" (UID: "ce098147-2f19-43b9-a187-99e4113d05e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:10:46.716997 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.716975    2560 scope.go:117] "RemoveContainer" containerID="2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"
Jul 24 15:10:46.717292 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:10:46.717272    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e\": container with ID starting with 2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e not found: ID does not exist" containerID="2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"
Jul 24 15:10:46.717366 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.717307    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e"} err="failed to get container status \"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e\": rpc error: code = NotFound desc = could not find container \"2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e\": container with ID starting with 2f62fd1adf139d283c585a6eb8dd8072e4feafdec4fbc6bcee7551b61fd50a5e not found: ID does not exist"
Jul 24 15:10:46.797674 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.797585    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce098147-2f19-43b9-a187-99e4113d05e5-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.797674 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.797613    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.797674 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.797621    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce098147-2f19-43b9-a187-99e4113d05e5-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:46.797674 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:46.797630    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnfdf\" (UniqueName: \"kubernetes.io/projected/ce098147-2f19-43b9-a187-99e4113d05e5-kube-api-access-jnfdf\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:10:47.020605 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:47.020539    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:10:47.026209 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:47.026181    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d170b/rate-test-model-0d170b-kserve-dd8fccc55-cfd2x"]
Jul 24 15:10:48.189588 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:48.189526    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce098147-2f19-43b9-a187-99e4113d05e5" path="/var/lib/kubelet/pods/ce098147-2f19-43b9-a187-99e4113d05e5/volumes"
Jul 24 15:10:51.823854 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:51.823811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:52.225222 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:52.225167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:52.390132 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:52.390092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:55.166469 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:55.166425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:55.265728 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:55.265697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:55.437762 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:55.437675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:55.758067 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:55.757974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:55.930848 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:55.930812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:56.034426 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.034348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:10:56.034741 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.034720    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:10:56.035129 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035113    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce098147-2f19-43b9-a187-99e4113d05e5" containerName="main"
Jul 24 15:10:56.035213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035132    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce098147-2f19-43b9-a187-99e4113d05e5" containerName="main"
Jul 24 15:10:56.035213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035165    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12459c2-a264-4765-9f22-322555f2a0d1" containerName="main"
Jul 24 15:10:56.035213 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035174    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12459c2-a264-4765-9f22-322555f2a0d1" containerName="main"
Jul 24 15:10:56.035372 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035283    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce098147-2f19-43b9-a187-99e4113d05e5" containerName="main"
Jul 24 15:10:56.035372 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.035302    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a12459c2-a264-4765-9f22-322555f2a0d1" containerName="main"
Jul 24 15:10:56.038450 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.038429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.040847 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.040824    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-600d4a\""
Jul 24 15:10:56.047783 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.047761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:10:56.049902 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.049879    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:10:56.059866 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.059836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.062727 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.062700    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-600d4a-dockercfg-5m75j\""
Jul 24 15:10:56.064019 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.063993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:10:56.090760 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.090715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.090760 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.090766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vv5\" (UniqueName: \"kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.192026 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.191994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlhx\" (UniqueName: \"kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.192475 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.192061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.192475 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.192119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vv5\" (UniqueName: \"kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.192475 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.192208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.192785 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.192769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.202537 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.202509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vv5\" (UniqueName: \"kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5\") pod \"payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.292944 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.292849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlhx\" (UniqueName: \"kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.293124 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.292995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.293662 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.293645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.303060 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.303034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlhx\" (UniqueName: \"kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx\") pod \"payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.350071 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.350030    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.373340 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.373312    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.517461 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.517439    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:10:56.520035 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:10:56.520012    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb781c8b9_9e91_4ba9_9087_5220f589af95.slice/crio-861b6c53555c8724d8bbddddbf4667290663374253c4376609b33d2b7199a752 WatchSource:0}: Error finding container 861b6c53555c8724d8bbddddbf4667290663374253c4376609b33d2b7199a752: Status 404 returned error can't find the container with id 861b6c53555c8724d8bbddddbf4667290663374253c4376609b33d2b7199a752
Jul 24 15:10:56.539498 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.539469    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:10:56.555815 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:10:56.555787    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f147af9_08ab_4cb6_8158_18dcdc35db71.slice/crio-25e3dd28fd25b5494b3fdb6df3ca0e433413819c811c026b3e40d43ffe5400b8 WatchSource:0}: Error finding container 25e3dd28fd25b5494b3fdb6df3ca0e433413819c811c026b3e40d43ffe5400b8: Status 404 returned error can't find the container with id 25e3dd28fd25b5494b3fdb6df3ca0e433413819c811c026b3e40d43ffe5400b8
Jul 24 15:10:56.748909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.748873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" event={"ID":"b781c8b9-9e91-4ba9-9087-5220f589af95","Type":"ContainerStarted","Data":"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"}
Jul 24 15:10:56.749096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.748935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" event={"ID":"b781c8b9-9e91-4ba9-9087-5220f589af95","Type":"ContainerStarted","Data":"861b6c53555c8724d8bbddddbf4667290663374253c4376609b33d2b7199a752"}
Jul 24 15:10:56.749096 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.749056    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:10:56.750431 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.750406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" event={"ID":"6f147af9-08ab-4cb6-8158-18dcdc35db71","Type":"ContainerStarted","Data":"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"}
Jul 24 15:10:56.750542 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.750444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" event={"ID":"6f147af9-08ab-4cb6-8158-18dcdc35db71","Type":"ContainerStarted","Data":"25e3dd28fd25b5494b3fdb6df3ca0e433413819c811c026b3e40d43ffe5400b8"}
Jul 24 15:10:56.750542 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.750464    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:10:56.767343 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.767287    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" podStartSLOduration=0.767269698 podStartE2EDuration="767.269698ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:56.766136297 +0000 UTC m=+2921.154156414" watchObservedRunningTime="2026-07-24 15:10:56.767269698 +0000 UTC m=+2921.155289815"
Jul 24 15:10:56.782883 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:56.782822    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" podStartSLOduration=0.782800967 podStartE2EDuration="782.800967ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:56.78150345 +0000 UTC m=+2921.169523569" watchObservedRunningTime="2026-07-24 15:10:56.782800967 +0000 UTC m=+2921.170821085"
Jul 24 15:10:59.812292 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:10:59.812261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:07.757641 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:07.757609    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:11:07.758011 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:07.757807    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:11:10.915074 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:10.915034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:11.277034 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:11.276947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:11.468850 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:11.468816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:14.222584 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:14.222526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:14.317089 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:14.317054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:14.394898 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:14.394864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:15.050391 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.050357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:15.149101 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.149070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:15.168518 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.168483    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:11:15.172207 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.172192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.174874 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.174849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5c17a6\""
Jul 24 15:11:15.189398 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.189373    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:11:15.206731 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.206693    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:11:15.210376 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.210359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.212962 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.212936    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5c17a6-dockercfg-b7wcg\""
Jul 24 15:11:15.219726 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.219700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:11:15.235931 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.235904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:15.284260 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.284223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhdj\" (UniqueName: \"kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.284432 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.284410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.385913 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.385872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhdj\" (UniqueName: \"kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.386136 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.385927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.386136 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.385947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5kc\" (UniqueName: \"kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.386136 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.386068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.386771 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.386754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.396010 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.395986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhdj\" (UniqueName: \"kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj\") pod \"payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.483308 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.483266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.486709 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.486683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.486758 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.486725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5kc\" (UniqueName: \"kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.487421 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.487403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.496985 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.496962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5kc\" (UniqueName: \"kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc\") pod \"payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.522944 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.522905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.638536 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.638508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:11:15.641986 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:11:15.641952    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59959332_2820_448c_bb4c_135b06a1b7e7.slice/crio-bb41259824af72f2644ddaf8823f00c021575bc64bd2d7dc8f91c44e7454af1b WatchSource:0}: Error finding container bb41259824af72f2644ddaf8823f00c021575bc64bd2d7dc8f91c44e7454af1b: Status 404 returned error can't find the container with id bb41259824af72f2644ddaf8823f00c021575bc64bd2d7dc8f91c44e7454af1b
Jul 24 15:11:15.687691 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.687659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:11:15.689845 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:11:15.689811    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2003c86_14b5_4c85_9830_f9821cb7bcb2.slice/crio-7de7fc617540014ff71119e12e5a8f2ae8a7962f811e8c6d159ba65a8eb7634a WatchSource:0}: Error finding container 7de7fc617540014ff71119e12e5a8f2ae8a7962f811e8c6d159ba65a8eb7634a: Status 404 returned error can't find the container with id 7de7fc617540014ff71119e12e5a8f2ae8a7962f811e8c6d159ba65a8eb7634a
Jul 24 15:11:15.849295 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.849240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" event={"ID":"f2003c86-14b5-4c85-9830-f9821cb7bcb2","Type":"ContainerStarted","Data":"653564c9a3883feab75839a22366f687b6586d04dbbaa08a86ed0f4b401afe30"}
Jul 24 15:11:15.849488 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.849307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" event={"ID":"f2003c86-14b5-4c85-9830-f9821cb7bcb2","Type":"ContainerStarted","Data":"7de7fc617540014ff71119e12e5a8f2ae8a7962f811e8c6d159ba65a8eb7634a"}
Jul 24 15:11:15.849488 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.849332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:15.850874 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.850851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" event={"ID":"59959332-2820-448c-bb4c-135b06a1b7e7","Type":"ContainerStarted","Data":"7fb1732b04004276dc3dd57f74226f042e9514e7d7c7b6ee50d585e87e5cb74c"}
Jul 24 15:11:15.850943 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.850902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:15.850943 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.850920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" event={"ID":"59959332-2820-448c-bb4c-135b06a1b7e7","Type":"ContainerStarted","Data":"bb41259824af72f2644ddaf8823f00c021575bc64bd2d7dc8f91c44e7454af1b"}
Jul 24 15:11:15.867745 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.867695    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" podStartSLOduration=0.867678181 podStartE2EDuration="867.678181ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:15.86647335 +0000 UTC m=+2940.254493467" watchObservedRunningTime="2026-07-24 15:11:15.867678181 +0000 UTC m=+2940.255698297"
Jul 24 15:11:15.888957 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:15.888862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" podStartSLOduration=0.888844871 podStartE2EDuration="888.844871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:15.886644145 +0000 UTC m=+2940.274664261" watchObservedRunningTime="2026-07-24 15:11:15.888844871 +0000 UTC m=+2940.276865044"
Jul 24 15:11:18.934945 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:18.934914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:26.858188 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:26.858153    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:11:26.858701 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:26.858228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:11:36.814598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:36.814543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn_f2003c86-14b5-4c85-9830-f9821cb7bcb2/payload-processing/0.log"
Jul 24 15:11:44.351114 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.351070    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:11:44.355043 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.355021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.358799 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.358777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-600d4a\"/\"ipp-route-600d4a-kserve-self-signed-certs\""
Jul 24 15:11:44.358943 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.358778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-600d4a\"/\"default-dockercfg-thclt\""
Jul 24 15:11:44.358943 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.358778    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-600d4a\"/\"openshift-service-ca.crt\""
Jul 24 15:11:44.358943 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.358827    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-600d4a\"/\"kube-root-ca.crt\""
Jul 24 15:11:44.367732 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.367709    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:11:44.382826 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.382795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:11:44.473137 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.473316 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.473316 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.473316 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck7l5\" (UniqueName: \"kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.473429 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.473429 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.473383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574134 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574134 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574356 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7l5\" (UniqueName: \"kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574356 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574356 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574356 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574663 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574735 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.574735 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.574719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.576909 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.576880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.577045 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.577030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.586833 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.586805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7l5\" (UniqueName: \"kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5\") pod \"ipp-route-600d4a-kserve-6f64544ff5-w5tqh\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") " pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.666882 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.666785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:44.814649 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:44.814623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:11:44.816654 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:11:44.816627    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61b75417_199a_48f7_8bf4_57e9ecab584f.slice/crio-f419223633add147c949c741452f0d3fd8aa7562d0556c35d01efd1e54b9ac6d WatchSource:0}: Error finding container f419223633add147c949c741452f0d3fd8aa7562d0556c35d01efd1e54b9ac6d: Status 404 returned error can't find the container with id f419223633add147c949c741452f0d3fd8aa7562d0556c35d01efd1e54b9ac6d
Jul 24 15:11:45.005210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:45.005112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" event={"ID":"61b75417-199a-48f7-8bf4-57e9ecab584f","Type":"ContainerStarted","Data":"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"}
Jul 24 15:11:45.005210 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:45.005157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" event={"ID":"61b75417-199a-48f7-8bf4-57e9ecab584f","Type":"ContainerStarted","Data":"f419223633add147c949c741452f0d3fd8aa7562d0556c35d01efd1e54b9ac6d"}
Jul 24 15:11:45.024618 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:45.024568    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" podStartSLOduration=1.024537956 podStartE2EDuration="1.024537956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:45.023159265 +0000 UTC m=+2969.411179384" watchObservedRunningTime="2026-07-24 15:11:45.024537956 +0000 UTC m=+2969.412558071"
Jul 24 15:11:54.667894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:54.667833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:54.667894 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:54.667908    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:54.680965 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:54.680938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:11:55.072500 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:11:55.072418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:12:15.791261 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:15.791232    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5_6f147af9-08ab-4cb6-8158-18dcdc35db71/payload-processing/0.log"
Jul 24 15:12:16.072354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:16.072285    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn_f2003c86-14b5-4c85-9830-f9821cb7bcb2/payload-processing/0.log"
Jul 24 15:12:16.358249 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:16.358212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:16.703881 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:16.703783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:17.333583 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:17.333530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:19.506754 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:19.506722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:19.608035 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:19.607942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:20.149695 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:20.149659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:20.545073 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:20.544983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:20.650259 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:20.650197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:20.745824 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:20.745794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:24.117271 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:24.117234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:43.375334 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:43.375299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:43.476832 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:43.476799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:45.863707 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:45.863669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:45.943088 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:45.943057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:46.009641 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:46.009586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:50.221714 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:50.221681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:50.660735 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:50.660704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:58.744952 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:58.744917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:58.818715 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:58.818678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:59.063974 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:59.063880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:12:59.319908 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:12:59.319813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:01.564879 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:01.564844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:18.795742 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.795658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:18.828653 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.828617    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:13:18.828899 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.828853    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" podUID="6f147af9-08ab-4cb6-8158-18dcdc35db71" containerName="payload-processing" containerID="cri-o://bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a" gracePeriod=30
Jul 24 15:13:18.835551 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.835521    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:13:18.836137 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.835777    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" podUID="b781c8b9-9e91-4ba9-9087-5220f589af95" containerName="payload-pre-processing" containerID="cri-o://69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd" gracePeriod=30
Jul 24 15:13:18.874825 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.874797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:18.943968 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:18.943872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:19.112757 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.112729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:13:19.115628 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.115606    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:13:19.201090 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201059    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vv5\" (UniqueName: \"kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5\") pod \"b781c8b9-9e91-4ba9-9087-5220f589af95\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") "
Jul 24 15:13:19.201273 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzlhx\" (UniqueName: \"kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx\") pod \"6f147af9-08ab-4cb6-8158-18dcdc35db71\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") "
Jul 24 15:13:19.201273 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume\") pod \"b781c8b9-9e91-4ba9-9087-5220f589af95\" (UID: \"b781c8b9-9e91-4ba9-9087-5220f589af95\") "
Jul 24 15:13:19.201273 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume\") pod \"6f147af9-08ab-4cb6-8158-18dcdc35db71\" (UID: \"6f147af9-08ab-4cb6-8158-18dcdc35db71\") "
Jul 24 15:13:19.201653 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b781c8b9-9e91-4ba9-9087-5220f589af95" (UID: "b781c8b9-9e91-4ba9-9087-5220f589af95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:13:19.201786 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.201628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f147af9-08ab-4cb6-8158-18dcdc35db71" (UID: "6f147af9-08ab-4cb6-8158-18dcdc35db71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:13:19.203478 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.203455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5" (OuterVolumeSpecName: "kube-api-access-p9vv5") pod "b781c8b9-9e91-4ba9-9087-5220f589af95" (UID: "b781c8b9-9e91-4ba9-9087-5220f589af95"). InnerVolumeSpecName "kube-api-access-p9vv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:13:19.203536 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.203484    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx" (OuterVolumeSpecName: "kube-api-access-fzlhx") pod "6f147af9-08ab-4cb6-8158-18dcdc35db71" (UID: "6f147af9-08ab-4cb6-8158-18dcdc35db71"). InnerVolumeSpecName "kube-api-access-fzlhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:13:19.302287 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.302252    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b781c8b9-9e91-4ba9-9087-5220f589af95-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.302287 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.302280    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f147af9-08ab-4cb6-8158-18dcdc35db71-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.302287 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.302289    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vv5\" (UniqueName: \"kubernetes.io/projected/b781c8b9-9e91-4ba9-9087-5220f589af95-kube-api-access-p9vv5\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.302532 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.302299    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzlhx\" (UniqueName: \"kubernetes.io/projected/6f147af9-08ab-4cb6-8158-18dcdc35db71-kube-api-access-fzlhx\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:19.488946 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.488909    2560 generic.go:356] "Generic (PLEG): container finished" podID="b781c8b9-9e91-4ba9-9087-5220f589af95" containerID="69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd" exitCode=0
Jul 24 15:13:19.489109 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.488952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"
Jul 24 15:13:19.489109 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.488996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" event={"ID":"b781c8b9-9e91-4ba9-9087-5220f589af95","Type":"ContainerDied","Data":"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"}
Jul 24 15:13:19.489109 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.489055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg" event={"ID":"b781c8b9-9e91-4ba9-9087-5220f589af95","Type":"ContainerDied","Data":"861b6c53555c8724d8bbddddbf4667290663374253c4376609b33d2b7199a752"}
Jul 24 15:13:19.489109 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.489084    2560 scope.go:117] "RemoveContainer" containerID="69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"
Jul 24 15:13:19.490339 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.490310    2560 generic.go:356] "Generic (PLEG): container finished" podID="6f147af9-08ab-4cb6-8158-18dcdc35db71" containerID="bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a" exitCode=0
Jul 24 15:13:19.490458 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.490349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" event={"ID":"6f147af9-08ab-4cb6-8158-18dcdc35db71","Type":"ContainerDied","Data":"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"}
Jul 24 15:13:19.490458 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.490363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"
Jul 24 15:13:19.490458 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.490383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5" event={"ID":"6f147af9-08ab-4cb6-8158-18dcdc35db71","Type":"ContainerDied","Data":"25e3dd28fd25b5494b3fdb6df3ca0e433413819c811c026b3e40d43ffe5400b8"}
Jul 24 15:13:19.498087 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.498068    2560 scope.go:117] "RemoveContainer" containerID="69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"
Jul 24 15:13:19.498424 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:13:19.498399    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd\": container with ID starting with 69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd not found: ID does not exist" containerID="69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"
Jul 24 15:13:19.498588 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.498434    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd"} err="failed to get container status \"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd\": rpc error: code = NotFound desc = could not find container \"69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd\": container with ID starting with 69b5ff798a5efd569be632b78cc71ca700eaa98950e0edbcba1f0d602efe9edd not found: ID does not exist"
Jul 24 15:13:19.498588 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.498458    2560 scope.go:117] "RemoveContainer" containerID="bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"
Jul 24 15:13:19.507398 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.507381    2560 scope.go:117] "RemoveContainer" containerID="bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"
Jul 24 15:13:19.507726 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:13:19.507705    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a\": container with ID starting with bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a not found: ID does not exist" containerID="bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"
Jul 24 15:13:19.507816 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.507734    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a"} err="failed to get container status \"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a\": rpc error: code = NotFound desc = could not find container \"bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a\": container with ID starting with bb688b533bff35449ee7a770290971e502d3669e3e6ab847950a8dd3202d764a not found: ID does not exist"
Jul 24 15:13:19.520224 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.518495    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:13:19.524291 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.524265    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-600d4a-5cf957bffb-gpnqg"]
Jul 24 15:13:19.535440 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.535408    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:13:19.538429 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:19.538408    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-600d4a-66b8f9768d-rt9j5"]
Jul 24 15:13:20.190095 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:20.190060    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f147af9-08ab-4cb6-8158-18dcdc35db71" path="/var/lib/kubelet/pods/6f147af9-08ab-4cb6-8158-18dcdc35db71/volumes"
Jul 24 15:13:20.190481 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:20.190431    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b781c8b9-9e91-4ba9-9087-5220f589af95" path="/var/lib/kubelet/pods/b781c8b9-9e91-4ba9-9087-5220f589af95/volumes"
Jul 24 15:13:23.225252 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:23.225216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:23.658746 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:23.658712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:28.644323 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:28.644284    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:13:28.700787 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:28.700752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:43.664285 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:43.664239    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" podUID="61b75417-199a-48f7-8bf4-57e9ecab584f" containerName="main" containerID="cri-o://1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36" gracePeriod=45
Jul 24 15:13:43.919394 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:43.919327    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:13:44.052936 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.052899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053120 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.052979    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053120 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053120 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck7l5\" (UniqueName: \"kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053120 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053067    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053334 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home\") pod \"61b75417-199a-48f7-8bf4-57e9ecab584f\" (UID: \"61b75417-199a-48f7-8bf4-57e9ecab584f\") "
Jul 24 15:13:44.053334 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache" (OuterVolumeSpecName: "model-cache") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:13:44.053453 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:13:44.053510 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053440    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home" (OuterVolumeSpecName: "home") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:13:44.053510 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.053432    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-model-cache\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.055474 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.055445    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm" (OuterVolumeSpecName: "dshm") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 15:13:44.055474 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.055468    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5" (OuterVolumeSpecName: "kube-api-access-ck7l5") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "kube-api-access-ck7l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:13:44.055655 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.055501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "61b75417-199a-48f7-8bf4-57e9ecab584f" (UID: "61b75417-199a-48f7-8bf4-57e9ecab584f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 15:13:44.154449 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.154413    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-home\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.154449 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.154440    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61b75417-199a-48f7-8bf4-57e9ecab584f-tls-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.154449 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.154452    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-dshm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.154705 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.154461    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck7l5\" (UniqueName: \"kubernetes.io/projected/61b75417-199a-48f7-8bf4-57e9ecab584f-kube-api-access-ck7l5\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.154705 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.154472    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61b75417-199a-48f7-8bf4-57e9ecab584f-tmp-dir\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:13:44.620050 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.620012    2560 generic.go:356] "Generic (PLEG): container finished" podID="61b75417-199a-48f7-8bf4-57e9ecab584f" containerID="1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36" exitCode=0
Jul 24 15:13:44.620220 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.620057    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"
Jul 24 15:13:44.620220 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.620106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" event={"ID":"61b75417-199a-48f7-8bf4-57e9ecab584f","Type":"ContainerDied","Data":"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"}
Jul 24 15:13:44.620220 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.620151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh" event={"ID":"61b75417-199a-48f7-8bf4-57e9ecab584f","Type":"ContainerDied","Data":"f419223633add147c949c741452f0d3fd8aa7562d0556c35d01efd1e54b9ac6d"}
Jul 24 15:13:44.620220 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.620171    2560 scope.go:117] "RemoveContainer" containerID="1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"
Jul 24 15:13:44.631832 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.631814    2560 scope.go:117] "RemoveContainer" containerID="1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"
Jul 24 15:13:44.632130 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:13:44.632108    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36\": container with ID starting with 1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36 not found: ID does not exist" containerID="1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"
Jul 24 15:13:44.632183 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.632140    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36"} err="failed to get container status \"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36\": rpc error: code = NotFound desc = could not find container \"1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36\": container with ID starting with 1ef5d852fd9a588a9cdee734dd77166e56a29c41df3498d6ce25541f867a4c36 not found: ID does not exist"
Jul 24 15:13:44.640528 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.640500    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:13:44.645315 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:44.645290    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-600d4a/ipp-route-600d4a-kserve-6f64544ff5-w5tqh"]
Jul 24 15:13:46.191318 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:46.191285    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b75417-199a-48f7-8bf4-57e9ecab584f" path="/var/lib/kubelet/pods/61b75417-199a-48f7-8bf4-57e9ecab584f/volumes"
Jul 24 15:13:48.305698 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:48.305666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:13:48.374510 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:13:48.374483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:05.622893 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:05.622855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:06.760070 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:06.760032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:13.057591 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:13.057536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:13.229043 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:13.229006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:13.417819 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:13.417778    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:13.695365 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:13.695278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:24.575145 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.575107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:24.612595 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.612543    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:14:24.612882 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.612840    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" podUID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" containerName="payload-processing" containerID="cri-o://653564c9a3883feab75839a22366f687b6586d04dbbaa08a86ed0f4b401afe30" gracePeriod=30
Jul 24 15:14:24.631370 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.631274    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:14:24.631535 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.631489    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" podUID="59959332-2820-448c-bb4c-135b06a1b7e7" containerName="payload-pre-processing" containerID="cri-o://7fb1732b04004276dc3dd57f74226f042e9514e7d7c7b6ee50d585e87e5cb74c" gracePeriod=30
Jul 24 15:14:24.671479 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.671444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:24.745902 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.745857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:24.826583 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.826489    2560 generic.go:356] "Generic (PLEG): container finished" podID="59959332-2820-448c-bb4c-135b06a1b7e7" containerID="7fb1732b04004276dc3dd57f74226f042e9514e7d7c7b6ee50d585e87e5cb74c" exitCode=0
Jul 24 15:14:24.826818 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.826578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" event={"ID":"59959332-2820-448c-bb4c-135b06a1b7e7","Type":"ContainerDied","Data":"7fb1732b04004276dc3dd57f74226f042e9514e7d7c7b6ee50d585e87e5cb74c"}
Jul 24 15:14:24.828774 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.828746    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" containerID="653564c9a3883feab75839a22366f687b6586d04dbbaa08a86ed0f4b401afe30" exitCode=0
Jul 24 15:14:24.828928 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.828808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" event={"ID":"f2003c86-14b5-4c85-9830-f9821cb7bcb2","Type":"ContainerDied","Data":"653564c9a3883feab75839a22366f687b6586d04dbbaa08a86ed0f4b401afe30"}
Jul 24 15:14:24.903571 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.903530    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:14:24.906702 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:24.906675    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:14:25.045484 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045444    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume\") pod \"59959332-2820-448c-bb4c-135b06a1b7e7\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") "
Jul 24 15:14:25.045689 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume\") pod \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") "
Jul 24 15:14:25.045689 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t5kc\" (UniqueName: \"kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc\") pod \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\" (UID: \"f2003c86-14b5-4c85-9830-f9821cb7bcb2\") "
Jul 24 15:14:25.045689 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rhdj\" (UniqueName: \"kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj\") pod \"59959332-2820-448c-bb4c-135b06a1b7e7\" (UID: \"59959332-2820-448c-bb4c-135b06a1b7e7\") "
Jul 24 15:14:25.045947 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045922    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59959332-2820-448c-bb4c-135b06a1b7e7" (UID: "59959332-2820-448c-bb4c-135b06a1b7e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:25.046029 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.045999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2003c86-14b5-4c85-9830-f9821cb7bcb2" (UID: "f2003c86-14b5-4c85-9830-f9821cb7bcb2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:25.047993 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.047956    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj" (OuterVolumeSpecName: "kube-api-access-8rhdj") pod "59959332-2820-448c-bb4c-135b06a1b7e7" (UID: "59959332-2820-448c-bb4c-135b06a1b7e7"). InnerVolumeSpecName "kube-api-access-8rhdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:25.048094 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.047996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc" (OuterVolumeSpecName: "kube-api-access-9t5kc") pod "f2003c86-14b5-4c85-9830-f9821cb7bcb2" (UID: "f2003c86-14b5-4c85-9830-f9821cb7bcb2"). InnerVolumeSpecName "kube-api-access-9t5kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:14:25.147367 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.147331    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rhdj\" (UniqueName: \"kubernetes.io/projected/59959332-2820-448c-bb4c-135b06a1b7e7-kube-api-access-8rhdj\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:14:25.147367 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.147361    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59959332-2820-448c-bb4c-135b06a1b7e7-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:14:25.147367 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.147372    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2003c86-14b5-4c85-9830-f9821cb7bcb2-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:14:25.147640 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.147381    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t5kc\" (UniqueName: \"kubernetes.io/projected/f2003c86-14b5-4c85-9830-f9821cb7bcb2-kube-api-access-9t5kc\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:14:25.835102 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.835069    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"
Jul 24 15:14:25.835571 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.835105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj" event={"ID":"59959332-2820-448c-bb4c-135b06a1b7e7","Type":"ContainerDied","Data":"bb41259824af72f2644ddaf8823f00c021575bc64bd2d7dc8f91c44e7454af1b"}
Jul 24 15:14:25.835571 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.835168    2560 scope.go:117] "RemoveContainer" containerID="7fb1732b04004276dc3dd57f74226f042e9514e7d7c7b6ee50d585e87e5cb74c"
Jul 24 15:14:25.836627 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.836611    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"
Jul 24 15:14:25.836895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.836625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn" event={"ID":"f2003c86-14b5-4c85-9830-f9821cb7bcb2","Type":"ContainerDied","Data":"7de7fc617540014ff71119e12e5a8f2ae8a7962f811e8c6d159ba65a8eb7634a"}
Jul 24 15:14:25.845212 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.845193    2560 scope.go:117] "RemoveContainer" containerID="653564c9a3883feab75839a22366f687b6586d04dbbaa08a86ed0f4b401afe30"
Jul 24 15:14:25.862188 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.862160    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:14:25.864645 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.864615    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c17a6-6465644448-9zlmj"]
Jul 24 15:14:25.877616 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.877591    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:14:25.882621 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:25.882596    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c17a6-6fb97c677d-f5mtn"]
Jul 24 15:14:26.190115 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:26.190081    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59959332-2820-448c-bb4c-135b06a1b7e7" path="/var/lib/kubelet/pods/59959332-2820-448c-bb4c-135b06a1b7e7/volumes"
Jul 24 15:14:26.190457 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:26.190445    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" path="/var/lib/kubelet/pods/f2003c86-14b5-4c85-9830-f9821cb7bcb2/volumes"
Jul 24 15:14:28.932207 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:28.932134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:29.411927 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:29.411857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:36.231794 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.231761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:36.295426 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.295396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:36.520672 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.520580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:36.768970 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.768919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:36.931709 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.931672    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"]
Jul 24 15:14:36.932075 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932062    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b781c8b9-9e91-4ba9-9087-5220f589af95" containerName="payload-pre-processing"
Jul 24 15:14:36.932121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932076    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b781c8b9-9e91-4ba9-9087-5220f589af95" containerName="payload-pre-processing"
Jul 24 15:14:36.932121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932091    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" containerName="payload-processing"
Jul 24 15:14:36.932121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932098    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" containerName="payload-processing"
Jul 24 15:14:36.932121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932108    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f147af9-08ab-4cb6-8158-18dcdc35db71" containerName="payload-processing"
Jul 24 15:14:36.932121 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932114    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f147af9-08ab-4cb6-8158-18dcdc35db71" containerName="payload-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932125    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59959332-2820-448c-bb4c-135b06a1b7e7" containerName="payload-pre-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932130    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="59959332-2820-448c-bb4c-135b06a1b7e7" containerName="payload-pre-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932142    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b75417-199a-48f7-8bf4-57e9ecab584f" containerName="main"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932147    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b75417-199a-48f7-8bf4-57e9ecab584f" containerName="main"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932202    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b75417-199a-48f7-8bf4-57e9ecab584f" containerName="main"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932211    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f147af9-08ab-4cb6-8158-18dcdc35db71" containerName="payload-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932218    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b781c8b9-9e91-4ba9-9087-5220f589af95" containerName="payload-pre-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932226    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="59959332-2820-448c-bb4c-135b06a1b7e7" containerName="payload-pre-processing"
Jul 24 15:14:36.932314 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.932232    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2003c86-14b5-4c85-9830-f9821cb7bcb2" containerName="payload-processing"
Jul 24 15:14:36.935519 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.935497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:36.938052 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.938024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 15:14:36.938052 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.938043    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n4c78\""
Jul 24 15:14:36.944732 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.944707    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"]
Jul 24 15:14:36.957598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:36.957539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-876f50-2blkl\" (UID: \"858fda7b-0600-4b57-ba0f-dd2bb18034c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:37.058179 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.058097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-876f50-2blkl\" (UID: \"858fda7b-0600-4b57-ba0f-dd2bb18034c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:37.058799 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.058781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-876f50-2blkl\" (UID: \"858fda7b-0600-4b57-ba0f-dd2bb18034c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:37.247956 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.247861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:37.385747 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.385720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"]
Jul 24 15:14:37.388619 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:14:37.388591    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858fda7b_0600_4b57_ba0f_dd2bb18034c9.slice/crio-3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199 WatchSource:0}: Error finding container 3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199: Status 404 returned error can't find the container with id 3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199
Jul 24 15:14:37.390983 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.390963    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 15:14:37.899772 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:37.899730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl" event={"ID":"858fda7b-0600-4b57-ba0f-dd2bb18034c9","Type":"ContainerStarted","Data":"3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199"}
Jul 24 15:14:40.916466 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:40.916424    2560 generic.go:356] "Generic (PLEG): container finished" podID="858fda7b-0600-4b57-ba0f-dd2bb18034c9" containerID="23cb6a06a909266614dd70e94220687e91b75b8f11a21a4d28ca915bbca4efe2" exitCode=0
Jul 24 15:14:40.916867 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:40.916513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl" event={"ID":"858fda7b-0600-4b57-ba0f-dd2bb18034c9","Type":"ContainerDied","Data":"23cb6a06a909266614dd70e94220687e91b75b8f11a21a4d28ca915bbca4efe2"}
Jul 24 15:14:42.062063 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.062035    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:42.107490 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.107453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca\") pod \"858fda7b-0600-4b57-ba0f-dd2bb18034c9\" (UID: \"858fda7b-0600-4b57-ba0f-dd2bb18034c9\") "
Jul 24 15:14:42.107878 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.107853    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "858fda7b-0600-4b57-ba0f-dd2bb18034c9" (UID: "858fda7b-0600-4b57-ba0f-dd2bb18034c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:14:42.208408 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.208368    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/858fda7b-0600-4b57-ba0f-dd2bb18034c9-maas-api-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:14:42.927300 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.927273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"
Jul 24 15:14:42.927300 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.927279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl" event={"ID":"858fda7b-0600-4b57-ba0f-dd2bb18034c9","Type":"ContainerDied","Data":"3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199"}
Jul 24 15:14:42.927522 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:42.927343    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aed966ba38556828c894a1cb799b32b3e55e092da0d9695e66486246367d199"
Jul 24 15:14:47.575959 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:47.575929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:47.673763 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:47.673728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:47.748609 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:47.748552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:52.073945 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:52.073908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:14:52.074400 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:52.074179    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"]
Jul 24 15:14:52.079987 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:52.079958    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-876f50-2blkl"]
Jul 24 15:14:52.189758 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:52.189724    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858fda7b-0600-4b57-ba0f-dd2bb18034c9" path="/var/lib/kubelet/pods/858fda7b-0600-4b57-ba0f-dd2bb18034c9/volumes"
Jul 24 15:14:52.497583 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:14:52.497529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:00.536002 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:00.535954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:00.608966 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:00.608932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:00.863084 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:00.863053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:01.079174 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:01.079143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:12.002658 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.002625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:12.046308 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.046274    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:15:12.046598 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.046546    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" podUID="41a03891-fc7e-4e4b-9d68-90e22adebd02" containerName="payload-pre-processing" containerID="cri-o://eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506" gracePeriod=30
Jul 24 15:15:12.095507 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:15:12.095468    2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a03891_fc7e_4e4b_9d68_90e22adebd02.slice/crio-conmon-eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a03891_fc7e_4e4b_9d68_90e22adebd02.slice/crio-eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506.scope\": RecentStats: unable to find data in memory cache]"
Jul 24 15:15:12.103547 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.103516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:12.207967 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.207935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:12.306912 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.306883    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:15:12.402250 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.402207    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume\") pod \"41a03891-fc7e-4e4b-9d68-90e22adebd02\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") "
Jul 24 15:15:12.402438 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.402278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m4pc\" (UniqueName: \"kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc\") pod \"41a03891-fc7e-4e4b-9d68-90e22adebd02\" (UID: \"41a03891-fc7e-4e4b-9d68-90e22adebd02\") "
Jul 24 15:15:12.402697 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.402669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41a03891-fc7e-4e4b-9d68-90e22adebd02" (UID: "41a03891-fc7e-4e4b-9d68-90e22adebd02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 15:15:12.404544 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.404521    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc" (OuterVolumeSpecName: "kube-api-access-7m4pc") pod "41a03891-fc7e-4e4b-9d68-90e22adebd02" (UID: "41a03891-fc7e-4e4b-9d68-90e22adebd02"). InnerVolumeSpecName "kube-api-access-7m4pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 15:15:12.503302 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.503256    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41a03891-fc7e-4e4b-9d68-90e22adebd02-plugins-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:15:12.503302 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:12.503294    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m4pc\" (UniqueName: \"kubernetes.io/projected/41a03891-fc7e-4e4b-9d68-90e22adebd02-kube-api-access-7m4pc\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\""
Jul 24 15:15:13.076707 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.076671    2560 generic.go:356] "Generic (PLEG): container finished" podID="41a03891-fc7e-4e4b-9d68-90e22adebd02" containerID="eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506" exitCode=0
Jul 24 15:15:13.077116 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.076721    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"
Jul 24 15:15:13.077116 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.076766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" event={"ID":"41a03891-fc7e-4e4b-9d68-90e22adebd02","Type":"ContainerDied","Data":"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"}
Jul 24 15:15:13.077116 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.076823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x" event={"ID":"41a03891-fc7e-4e4b-9d68-90e22adebd02","Type":"ContainerDied","Data":"12b23a5b807309c9315519f287af2c7add608b53473b4eab1c45f22a5089d73c"}
Jul 24 15:15:13.077116 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.076851    2560 scope.go:117] "RemoveContainer" containerID="eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"
Jul 24 15:15:13.088913 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.087759    2560 scope.go:117] "RemoveContainer" containerID="eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"
Jul 24 15:15:13.088913 ip-10-0-132-253 kubenswrapper[2560]: E0724 15:15:13.088177    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506\": container with ID starting with eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506 not found: ID does not exist" containerID="eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"
Jul 24 15:15:13.088913 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.088226    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506"} err="failed to get container status \"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506\": rpc error: code = NotFound desc = could not find container \"eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506\": container with ID starting with eabd1140ca33076712e46fa5c614b66c3590d1682a77b2813f4f4fccded55506 not found: ID does not exist"
Jul 24 15:15:13.104724 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.104688    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:15:13.109343 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:13.109315    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0d170b-69799f8896-pcd5x"]
Jul 24 15:15:14.189941 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:14.189910    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41a03891-fc7e-4e4b-9d68-90e22adebd02" path="/var/lib/kubelet/pods/41a03891-fc7e-4e4b-9d68-90e22adebd02/volumes"
Jul 24 15:15:16.320931 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:16.320898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:16.743582 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:16.743517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:23.529199 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:23.529150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:23.656873 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:23.656837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:23.907193 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:23.907161    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:24.117118 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:24.117076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:24.565262 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:24.565201    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784cd7df58-xfqz8_202ad90d-1da5-4873-a036-6f4182f663f5/authorino/0.log"
Jul 24 15:15:31.151484 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:31.151455    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-hfvqm_c78ac5b3-58e4-48e0-8bab-53fafe5443b6/copy-manifests/0.log"
Jul 24 15:15:31.159355 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:31.159333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-hfvqm_c78ac5b3-58e4-48e0-8bab-53fafe5443b6/manager/0.log"
Jul 24 15:15:33.729233 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:33.729201    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784cd7df58-xfqz8_202ad90d-1da5-4873-a036-6f4182f663f5/authorino/0.log"
Jul 24 15:15:33.856646 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:33.856613    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-w4qr6_706e1945-5bb8-4808-97f4-3310dc01230c/manager/0.log"
Jul 24 15:15:34.112760 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:34.112738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2pxp2_6dc8244f-0513-444c-bbf1-ccfa41558a48/kuadrant-console-plugin/0.log"
Jul 24 15:15:35.284258 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:35.284223    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b7bd974d-6wl78_569a6bb8-8794-4ccb-bee3-26e386db66da/kube-auth-proxy/0.log"
Jul 24 15:15:35.665668 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:35.665640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zgcgc_84789551-2577-4084-8ac7-35438627b39d/payload-pre-processing/0.log"
Jul 24 15:15:36.441865 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:36.441833    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-htg5r_7794f945-7eb2-472a-8f41-8fc2e3736a19/main/0.log"
Jul 24 15:15:36.567986 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:36.567958    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nqwjc_1e6a001a-e9be-4d4f-b148-aa0a914d8f78/main/0.log"
Jul 24 15:15:36.816621 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:36.816537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hl84n_9cbfabec-f466-4c99-9803-6130c2661a09/main/0.log"
Jul 24 15:15:36.936006 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:36.935973    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-2ntkg_e77f8dfe-7e41-4d75-896f-bd9877798c0c/main/0.log"
Jul 24 15:15:42.843032 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:42.842999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:42.937856 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:42.937823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:45.652890 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:45.652848    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gv2s_3f0275c3-34a2-49dd-86e1-1f90c3139a98/global-pull-secret-syncer/0.log"
Jul 24 15:15:45.808083 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:45.808041    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log"
Jul 24 15:15:45.934367 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:45.934258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-253.ec2.internal_f6b45e66dca16cb6315837888a243eec/haproxy/0.log"
Jul 24 15:15:47.322186 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:47.322131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-429hb_13898532-553c-450b-93c3-1c8a298e9c56/konnectivity-agent/0.log" limit=1024
Jul 24 15:15:50.912828 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:50.912731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-784cd7df58-xfqz8_202ad90d-1da5-4873-a036-6f4182f663f5/authorino/0.log"
Jul 24 15:15:50.955433 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:50.955396    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-w4qr6_706e1945-5bb8-4808-97f4-3310dc01230c/manager/0.log"
Jul 24 15:15:51.030095 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:51.030068    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2pxp2_6dc8244f-0513-444c-bbf1-ccfa41558a48/kuadrant-console-plugin/0.log"
Jul 24 15:15:53.134403 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.134373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/alertmanager/0.log"
Jul 24 15:15:53.162662 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.162627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/config-reloader/0.log"
Jul 24 15:15:53.193708 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.193681    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/kube-rbac-proxy-web/0.log"
Jul 24 15:15:53.227211 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.227176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/kube-rbac-proxy/0.log"
Jul 24 15:15:53.256354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.256330    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/kube-rbac-proxy-metric/0.log"
Jul 24 15:15:53.283576 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.283529    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/prom-label-proxy/0.log"
Jul 24 15:15:53.311490 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.311407    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6137a2ec-5b5b-4847-b1e4-386e9edec39f/init-config-reloader/0.log"
Jul 24 15:15:53.418897 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.418850    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x56vv_45cc87a3-eb4f-4e85-87ff-27e8f0994e6e/kube-state-metrics/0.log"
Jul 24 15:15:53.447079 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.447047    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x56vv_45cc87a3-eb4f-4e85-87ff-27e8f0994e6e/kube-rbac-proxy-main/0.log"
Jul 24 15:15:53.475109 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.475076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-x56vv_45cc87a3-eb4f-4e85-87ff-27e8f0994e6e/kube-rbac-proxy-self/0.log"
Jul 24 15:15:53.508127 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.508101    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-74b464c774-n5gtg_b17410ad-2827-47c7-af64-26d31dd87f47/metrics-server/0.log"
Jul 24 15:15:53.796328 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.796295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhf7_b7b00859-4a46-4d22-8361-d694fe366590/node-exporter/0.log"
Jul 24 15:15:53.820049 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.820023    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhf7_b7b00859-4a46-4d22-8361-d694fe366590/kube-rbac-proxy/0.log"
Jul 24 15:15:53.844468 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.844438    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhf7_b7b00859-4a46-4d22-8361-d694fe366590/init-textfile/0.log"
Jul 24 15:15:53.877345 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.877316    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-sch7f_0099bc23-4cbe-4cbd-928c-5375928a98ab/kube-rbac-proxy-main/0.log"
Jul 24 15:15:53.918539 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.918514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-sch7f_0099bc23-4cbe-4cbd-928c-5375928a98ab/kube-rbac-proxy-self/0.log"
Jul 24 15:15:53.947442 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.947418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-sch7f_0099bc23-4cbe-4cbd-928c-5375928a98ab/openshift-state-metrics/0.log"
Jul 24 15:15:53.987044 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:53.987019    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/prometheus/0.log"
Jul 24 15:15:54.015296 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.015264    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/config-reloader/0.log"
Jul 24 15:15:54.043159 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.043132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/thanos-sidecar/0.log"
Jul 24 15:15:54.074717 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.074645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/kube-rbac-proxy-web/0.log"
Jul 24 15:15:54.101998 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.101963    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/kube-rbac-proxy/0.log"
Jul 24 15:15:54.129337 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.129311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/kube-rbac-proxy-thanos/0.log"
Jul 24 15:15:54.157474 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.157443    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c29eeb34-15e5-4c22-b055-65293a826569/init-config-reloader/0.log"
Jul 24 15:15:54.276537 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.276509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58f67fd986-cwf84_54160696-41fd-4b22-aa17-799987782367/telemeter-client/0.log"
Jul 24 15:15:54.300847 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.300822    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58f67fd986-cwf84_54160696-41fd-4b22-aa17-799987782367/reload/0.log"
Jul 24 15:15:54.326721 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.326650    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58f67fd986-cwf84_54160696-41fd-4b22-aa17-799987782367/kube-rbac-proxy/0.log"
Jul 24 15:15:54.362039 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.362012    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/thanos-query/0.log"
Jul 24 15:15:54.388287 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.388265    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/kube-rbac-proxy-web/0.log"
Jul 24 15:15:54.414331 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.414306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/kube-rbac-proxy/0.log"
Jul 24 15:15:54.438607 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.438581    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/prom-label-proxy/0.log"
Jul 24 15:15:54.463390 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.463362    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/kube-rbac-proxy-rules/0.log"
Jul 24 15:15:54.490771 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:54.490741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dffdc588-z2k9b_66352125-bb1d-43e0-9397-0991a540561f/kube-rbac-proxy-metrics/0.log"
Jul 24 15:15:55.903217 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903181    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"]
Jul 24 15:15:55.903746 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903652    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41a03891-fc7e-4e4b-9d68-90e22adebd02" containerName="payload-pre-processing"
Jul 24 15:15:55.903746 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903667    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41a03891-fc7e-4e4b-9d68-90e22adebd02" containerName="payload-pre-processing"
Jul 24 15:15:55.903746 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903712    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858fda7b-0600-4b57-ba0f-dd2bb18034c9" containerName="revoke-keys"
Jul 24 15:15:55.903746 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903717    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="858fda7b-0600-4b57-ba0f-dd2bb18034c9" containerName="revoke-keys"
Jul 24 15:15:55.903896 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903770    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="858fda7b-0600-4b57-ba0f-dd2bb18034c9" containerName="revoke-keys"
Jul 24 15:15:55.903896 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.903782    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41a03891-fc7e-4e4b-9d68-90e22adebd02" containerName="payload-pre-processing"
Jul 24 15:15:55.906820 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.906796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:55.909794 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.909773    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44pkg\"/\"openshift-service-ca.crt\""
Jul 24 15:15:55.909920 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.909825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44pkg\"/\"kube-root-ca.crt\""
Jul 24 15:15:55.909920 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.909887    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44pkg\"/\"default-dockercfg-6psc7\""
Jul 24 15:15:55.918530 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:55.918501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"]
Jul 24 15:15:56.027723 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.027687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfgr\" (UniqueName: \"kubernetes.io/projected/155fadfc-db8f-4505-9522-48f48f35b62c-kube-api-access-lrfgr\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.027923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.027783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-sys\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.027923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.027817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-lib-modules\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.027923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.027842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-proc\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.027923 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.027909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-podres\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129153 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-sys\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-lib-modules\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-proc\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-podres\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-sys\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfgr\" (UniqueName: \"kubernetes.io/projected/155fadfc-db8f-4505-9522-48f48f35b62c-kube-api-access-lrfgr\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129354 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-proc\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129707 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-podres\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.129707 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.129369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/155fadfc-db8f-4505-9522-48f48f35b62c-lib-modules\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.139763 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.139744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfgr\" (UniqueName: \"kubernetes.io/projected/155fadfc-db8f-4505-9522-48f48f35b62c-kube-api-access-lrfgr\") pod \"perf-node-gather-daemonset-bcbpk\" (UID: \"155fadfc-db8f-4505-9522-48f48f35b62c\") " pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.219919 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.219813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:56.362888 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:56.360837    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"]
Jul 24 15:15:56.365865 ip-10-0-132-253 kubenswrapper[2560]: W0724 15:15:56.365839    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod155fadfc_db8f_4505_9522_48f48f35b62c.slice/crio-3f2fde70883ea54907ea8b10c752844b6e35d939d385f39d15f95f0c53b10c78 WatchSource:0}: Error finding container 3f2fde70883ea54907ea8b10c752844b6e35d939d385f39d15f95f0c53b10c78: Status 404 returned error can't find the container with id 3f2fde70883ea54907ea8b10c752844b6e35d939d385f39d15f95f0c53b10c78
Jul 24 15:15:57.290054 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:57.290017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk" event={"ID":"155fadfc-db8f-4505-9522-48f48f35b62c","Type":"ContainerStarted","Data":"b1b79a29e9ec2bc1da0dbc035957d12d109e0310ec3d36aea71c906173a7b22b"}
Jul 24 15:15:57.290470 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:57.290070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk" event={"ID":"155fadfc-db8f-4505-9522-48f48f35b62c","Type":"ContainerStarted","Data":"3f2fde70883ea54907ea8b10c752844b6e35d939d385f39d15f95f0c53b10c78"}
Jul 24 15:15:57.290470 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:57.290124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:15:57.309270 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:57.309219    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk" podStartSLOduration=2.309204026 podStartE2EDuration="2.309204026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:15:57.307350808 +0000 UTC m=+3221.695370925" watchObservedRunningTime="2026-07-24 15:15:57.309204026 +0000 UTC m=+3221.697224142"
Jul 24 15:15:58.629119 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:58.629088    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt4kj_d6631cc0-d090-497c-b60d-42a7b9105290/dns/0.log"
Jul 24 15:15:58.655706 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:58.655681    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qt4kj_d6631cc0-d090-497c-b60d-42a7b9105290/kube-rbac-proxy/0.log"
Jul 24 15:15:58.798875 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:58.798839    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bgg62_e14bb84c-ca41-4f10-b17c-12303ccb29ff/dns-node-resolver/0.log"
Jul 24 15:15:59.522023 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:15:59.521985    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kd2fr_af0f1cba-33e8-4546-b0b8-69f8035511fc/node-ca/0.log"
Jul 24 15:16:00.753768 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:00.753740    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b7bd974d-6wl78_569a6bb8-8794-4ccb-bee3-26e386db66da/kube-auth-proxy/0.log"
Jul 24 15:16:00.914092 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:00.914060    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zgcgc_84789551-2577-4084-8ac7-35438627b39d/payload-pre-processing/0.log"
Jul 24 15:16:01.835895 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:01.835861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfnwk_51936153-9ec5-4b86-938f-4b442a16d6d6/serve-healthcheck-canary/0.log"
Jul 24 15:16:02.522322 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:02.522295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5k7g_c3d3c469-b3c0-48c1-bb92-0adab569d4fa/kube-rbac-proxy/0.log"
Jul 24 15:16:02.546642 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:02.546619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5k7g_c3d3c469-b3c0-48c1-bb92-0adab569d4fa/exporter/0.log"
Jul 24 15:16:02.570166 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:02.570131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5k7g_c3d3c469-b3c0-48c1-bb92-0adab569d4fa/extractor/0.log"
Jul 24 15:16:03.305627 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:03.305600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44pkg/perf-node-gather-daemonset-bcbpk"
Jul 24 15:16:05.814612 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:05.814505    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-hfvqm_c78ac5b3-58e4-48e0-8bab-53fafe5443b6/manager/0.log"
Jul 24 15:16:05.844504 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:05.844472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bbcbb69d-hfvqm_c78ac5b3-58e4-48e0-8bab-53fafe5443b6/copy-manifests/0.log"
Jul 24 15:16:06.229638 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:06.229610    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b7bd974d-6wl78_569a6bb8-8794-4ccb-bee3-26e386db66da/kube-auth-proxy/0.log"
Jul 24 15:16:06.376832 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:06.376806    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zgcgc_84789551-2577-4084-8ac7-35438627b39d/payload-pre-processing/0.log"
Jul 24 15:16:07.420156 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:07.420131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76765b76bd-lz279_c1f93aa3-9428-405d-8450-3fafdf028326/manager/0.log"
Jul 24 15:16:07.483915 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:07.483889    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cpk2s_ce627206-a0f6-4ef3-be7c-1eb37651f187/openshift-lws-operator/0.log"
Jul 24 15:16:08.033442 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:08.033336    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b7bd974d-6wl78_569a6bb8-8794-4ccb-bee3-26e386db66da/kube-auth-proxy/0.log"
Jul 24 15:16:08.163607 ip-10-0-132-253 kubenswrapper[2560]: I0724 15:16:08.163572    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zgcgc_84789551-2577-4084-8ac7-35438627b39d/payload-pre-processing/0.log"