Jul 28 22:04:32.558904 ip-10-0-133-142 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 22:04:32.997275 ip-10-0-133-142 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:32.997275 ip-10-0-133-142 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 22:04:32.997275 ip-10-0-133-142 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:32.997275 ip-10-0-133-142 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 22:04:32.997275 ip-10-0-133-142 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:32.998355 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:32.998268    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 22:04:33.005019 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005001    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.005019 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005019    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005023    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005026    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005029    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005032    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005038    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005042    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005045    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005048    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005052    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005055    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005057    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005061    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005064    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005067    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005070    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005073    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005075    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005078    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.005087 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005080    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005083    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005085    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005088    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005091    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005094    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005099    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005102    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005105    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005108    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005111    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005113    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005115    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005118    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005121    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005123    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005126    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005129    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005131    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.005537 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005133    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005143    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005145    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005148    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005150    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005152    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005155    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005158    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005160    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005162    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005165    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005167    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005170    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005172    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005175    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005178    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005181    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005184    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005187    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005189    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.006047 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005191    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005194    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005196    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005198    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005201    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005204    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005233    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005237    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005241    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005246    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005249    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005252    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005255    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005257    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005266    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005268    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005271    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005273    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005276    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005278    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.006532 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005281    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005283    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005286    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005289    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005291    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005295    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005299    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005302    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005313    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005317    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005321    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005324    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005326    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005329    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005332    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005334    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005337    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005339    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005342    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.007020 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.005345    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.007942 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007928    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.007942 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007941    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007945    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007948    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007952    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007954    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007957    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007960    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007963    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007966    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007969    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007972    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007974    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007977    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007980    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007982    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007985    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007988    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007991    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007995    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.007998    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.007997 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008002    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008005    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008008    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008011    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008014    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008017    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008019    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008022    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008024    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008027    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008029    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008032    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008035    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008037    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008040    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008042    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008046    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008049    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008052    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008055    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.008495 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008058    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008060    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008063    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008065    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008068    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008070    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008073    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008075    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008078    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008080    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008084    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008086    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008089    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008091    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008095    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008098    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008100    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008103    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008105    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008108    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.009022 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008111    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008113    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008116    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008118    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008121    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008124    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008126    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008129    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008131    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008134    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008138    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008142    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008145    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008148    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008153    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008155    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008158    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008160    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008164    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008166    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.009506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008169    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008172    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008174    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008177    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008179    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008182    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008185    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008187    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008190    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008192    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008195    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008198    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008200    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008203    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008206    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008208    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008211    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.008214    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009635    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009642    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.010028 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009645    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009649    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009653    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009657    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009661    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009664    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009667    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009670    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009672    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009675    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009678    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009680    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009683    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009686    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009689    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009691    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009694    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009697    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009700    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009702    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.010533 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009705    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009708    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009710    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009713    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009715    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009718    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009721    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009723    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009726    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009728    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009731    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009733    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009736    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009738    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009741    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009744    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009746    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009749    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009753    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009755    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.011065 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009758    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009760    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009763    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009765    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009768    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009771    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009773    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009776    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009778    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009781    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009784    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009786    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009788    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009791    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009795    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009799    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009801    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009804    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009807    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009809    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.011548 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009811    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009814    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009816    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009819    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009822    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009824    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009827    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009829    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009832    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009835    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009841    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009844    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009846    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009849    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009851    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009854    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009857    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009860    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009862    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.012050 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009865    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009867    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009870    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009873    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009875    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009878    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009880    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009883    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009885    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009888    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009890    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009893    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009896    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009898    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009900    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009904    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009907    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.009910    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.009983    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.009997    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 22:04:33.012507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010004    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010009    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010013    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010018    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010023    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010028    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010032    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010035    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010039    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010042    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010046    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010049    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010052    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010055    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010058    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010061    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010066    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010068    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010072    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010075    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010078    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010082    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010085    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 22:04:33.012998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010088    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010091    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010095    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010097    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010100    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010104    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010107    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010111    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010114    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010117    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010120    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010123    2563 flags.go:64] FLAG: --enable-server="true"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010127    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010132    2563 flags.go:64] FLAG: --event-burst="100"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010135    2563 flags.go:64] FLAG: --event-qps="50"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010138    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010142    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010145    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010149    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010152    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010155    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010158    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010161    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010164    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010167    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 22:04:33.013556 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010170    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010173    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010176    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010179    2563 flags.go:64] FLAG: --feature-gates=""
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010183    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010185    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010189    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010192    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010195    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010198    2563 flags.go:64] FLAG: --help="false"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010201    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010204    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010208    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010211    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010214    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010218    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010222    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010224    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010227    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010230    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010233    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010236    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010239    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010242    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 22:04:33.014241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010245    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010248    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010251    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010254    2563 flags.go:64] FLAG: --lock-file=""
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010257    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010259    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010262    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010268    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010271    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010273    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010276    2563 flags.go:64] FLAG: --logging-format="text"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010279    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010282    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010285    2563 flags.go:64] FLAG: --manifest-url=""
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010287    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010292    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010295    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010300    2563 flags.go:64] FLAG: --max-pods="110"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010303    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010306    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010309    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010312    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010315    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010318    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010320    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 22:04:33.014864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010327    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010330    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010333    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010336    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010339    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010345    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010349    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010352    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010355    2563 flags.go:64] FLAG: --port="10250"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010358    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010361    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c932ed6dd4634dc3"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010365    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010368    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010371    2563 flags.go:64] FLAG: --register-node="true"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010374    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010377    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010380    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010383    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010386    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010390    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010393    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010396    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010399    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010402    2563 flags.go:64] FLAG: --runonce="false"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010405    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 22:04:33.015481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010408    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010411    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010414    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010416    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010420    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010423    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010428    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010431    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010434    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010437    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010440    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010443    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010446    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010449    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010454    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010457    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010460    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010464    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010468    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010470    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010473    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010476    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010479    2563 flags.go:64] FLAG: --v="2"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010483    2563 flags.go:64] FLAG: --version="false"
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010487    2563 flags.go:64] FLAG: --vmodule=""
Jul 28 22:04:33.016106 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010490    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010494    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010642    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010646    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010649    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010652    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010656    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010659    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010662    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010665    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010667    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010670    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010672    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010677    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010679    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010682    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010684    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010688    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010691    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010693    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.016745 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010696    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010698    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010702    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010704    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010707    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010710    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010712    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010715    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010718    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010721    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010723    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010726    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010728    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010731    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010734    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010738    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010741    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010744    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010748    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.017243 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010751    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010754    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010757    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010759    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010762    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010765    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010770    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010772    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010775    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010779    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010782    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010785    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010787    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010790    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010793    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010796    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010799    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010801    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010804    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.017828 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010806    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010809    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010812    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010814    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010817    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010819    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010822    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010826    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010829    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010832    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010834    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010837    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010841    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010844    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010847    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010849    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010852    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010855    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010857    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010861    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.018632 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010863    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010866    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010869    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010871    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010874    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010877    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010879    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010882    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010884    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010887    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010891    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010894    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010897    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010900    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010903    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010905    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010908    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010910    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010913    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010916    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.019164 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010918    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.019674 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010921    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.019674 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.010923    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.019674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.010929    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:33.019763 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.019736    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 22:04:33.019763 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.019753    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 22:04:33.019818 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.019773    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 22:04:33.019818 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.019780    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019838    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019844    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019847    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019850    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019854    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019856    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019859    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019861    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019865    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019869    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019872    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.019871 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019875    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019879    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019881    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019884    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019887    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019889    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019892    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019895    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019898    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019901    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019903    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019906    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019908    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019911    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019914    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019916    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019919    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019922    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019925    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019928    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019930    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.020168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019932    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019936    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019940    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019943    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019946    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019948    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019951    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019953    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019956    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019959    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019961    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019964    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019966    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019970    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019973    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019976    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019978    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019981    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019983    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019986    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.020691 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019989    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019991    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019994    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019996    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.019999    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020001    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020004    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020007    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020010    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020012    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020015    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020017    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020020    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020023    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020025    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020028    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020030    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020033    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020035    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020040    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.021176 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020043    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020046    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020049    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020052    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020054    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020058    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020061    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020071    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020075    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020077    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020080    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020083    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020085    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020088    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020090    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020093    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020096    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020098    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020101    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.021680 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020103    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020106    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020108    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020111    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020114    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020116    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020119    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020121    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.020127    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020252    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020257    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020260    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020263    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020266    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020269    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:33.022168 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020271    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020274    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020277    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020279    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020282    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020285    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020293    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020296    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020299    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020302    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020305    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020307    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020310    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020313    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020316    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020318    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020321    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020323    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020326    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:33.022539 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020329    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020332    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020334    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020337    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020340    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020342    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020345    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020347    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020349    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020352    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020355    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020357    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020360    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020363    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020366    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020368    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020371    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020373    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020376    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020379    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:33.023011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020387    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020389    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020392    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020394    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020398    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020402    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020404    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020406    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020409    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020412    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020414    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020417    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020419    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020422    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020424    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020427    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020429    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020433    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:33.023498 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020436    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020439    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020442    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020444    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020447    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020449    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020452    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020456    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020459    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020462    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020465    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020468    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020471    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020474    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020477    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020481    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020484    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020486    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020489    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020492    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:33.024062 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020494    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020497    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020499    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020502    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020504    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020507    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020510    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020512    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020515    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020517    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020520    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020522    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020525    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020527    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020530    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:33.024541 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:33.020532    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:33.024922 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.020537    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:33.024922 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.020673    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 22:04:33.025843 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.025826    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 22:04:33.027507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.027495    2563 server.go:1019] "Starting client certificate rotation"
Jul 28 22:04:33.027631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.027613    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 22:04:33.027697 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.027661    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 22:04:33.030314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.030296    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 22:04:33.033563 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.033544    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 22:04:33.050310 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.050290    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 28 22:04:33.052983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.052966    2563 log.go:25] "Validated CRI v1 image API"
Jul 28 22:04:33.053817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.053802    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 22:04:33.054611 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.054595    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 22:04:33.059911 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.059890    2563 fs.go:135] Filesystem UUIDs: map[754dfa3e-3a84-48da-b2f2-a45433c8b044:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a52f8042-c679-4597-9f67-7ca51e989fc4:/dev/nvme0n1p4]
Jul 28 22:04:33.059983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.059911    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 22:04:33.066424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.066306    2563 manager.go:216] Machine: {Timestamp:2026-07-28 22:04:33.064878642 +0000 UTC m=+0.377117624 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110504 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7c9945c8079ce71bd4e8d4549748 SystemUUID:ec2f7c99-45c8-079c-e71b-d4e8d4549748 BootID:8d7f5057-7871-47ed-9b31-014914eeca6e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:4a:d3:60:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:4a:d3:60:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:02:73:3b:e2:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 22:04:33.066424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.066419    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 22:04:33.066560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.066496    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 22:04:33.070802 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.070603    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 22:04:33.070940 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.070802    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 22:04:33.071679 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.071669    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 22:04:33.071719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.071683    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 22:04:33.071719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.071691    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 22:04:33.071719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.071706    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 22:04:33.072962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.072952    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 22:04:33.075817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075796    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 22:04:33.075944 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075934    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 22:04:33.075982 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075965    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 22:04:33.075982 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075974    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 22:04:33.076051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075984    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 22:04:33.076051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.075993    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 28 22:04:33.076051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.076007    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 22:04:33.076412 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.076396    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 22:04:33.076479 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.076420    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 22:04:33.078719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.078701    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 22:04:33.081282 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.081267    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 22:04:33.081345 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.081297    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 22:04:33.083367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083355    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 22:04:33.083367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083370    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083376    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083381    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083390    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083395    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083403    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083408    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083414    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083419    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083428    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 22:04:33.083464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.083433    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 22:04:33.084343 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.084332    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 22:04:33.084343 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.084341    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 22:04:33.087354 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.087339    2563 server.go:1268] "Started kubelet"
Jul 28 22:04:33.087490 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.087415    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 22:04:33.087558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.087454    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 22:04:33.087621 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.087592    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 22:04:33.088213 ip-10-0-133-142 systemd[1]: Started Kubernetes Kubelet.
Jul 28 22:04:33.089720 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.089700    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 22:04:33.089801 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.089754    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 22:04:33.092715 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.092401    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 22:04:33.092715 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.092419    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 22:04:33.092715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.092604    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 22:04:33.093834 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.092658    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-142.ec2.internal.18c6934fc34d7643  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-142.ec2.internal,UID:ip-10-0-133-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-142.ec2.internal,},FirstTimestamp:2026-07-28 22:04:33.087313475 +0000 UTC m=+0.399552457,LastTimestamp:2026-07-28 22:04:33.087313475 +0000 UTC m=+0.399552457,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-142.ec2.internal,}"
Jul 28 22:04:33.095359 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.095337    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 22:04:33.097824 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.097806    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpx99"
Jul 28 22:04:33.100766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.100749    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 22:04:33.100869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.100763    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 22:04:33.100869 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.100827    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.101894 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.101736    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 22:04:33.101894 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.101784    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 22:04:33.101894 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.101844    2563 factory.go:55] Registering systemd factory
Jul 28 22:04:33.101894 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.101858    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102038    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102139    2563 factory.go:153] Registering CRI-O factory
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102150    2563 factory.go:223] Registration of the crio container factory successfully
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102203    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102227    2563 factory.go:103] Registering Raw factory
Jul 28 22:04:33.102402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102298    2563 manager.go:1196] Started watching for new ooms in manager
Jul 28 22:04:33.102643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102528    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 22:04:33.102643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102544    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 22:04:33.102913 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.102883    2563 manager.go:349] Starting recovery of all containers
Jul 28 22:04:33.104672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.104651    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpx99"
Jul 28 22:04:33.113118 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.113086    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 22:04:33.113442 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.113412    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 22:04:33.113557 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.113524    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 22:04:33.115547 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.115468    2563 manager.go:354] Recovery completed
Jul 28 22:04:33.120060 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.120045    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.121980 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.121964    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.122055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.121995    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.122055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.122009    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.122625 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.122611    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 22:04:33.122699 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.122625    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 22:04:33.122699 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.122639    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.122772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.122643    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 22:04:33.123548 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.123534    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.123646 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.123561    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.123646 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.123572    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.125457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.125446    2563 policy_none.go:49] "None policy: Start"
Jul 28 22:04:33.125506 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.125463    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 22:04:33.125506 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.125473    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 22:04:33.127446 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.127434    2563 policy_none.go:47] "Start"
Jul 28 22:04:33.157459 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.157279    2563 manager.go:337] "Starting Device Plugin manager"
Jul 28 22:04:33.157610 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.157495    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 22:04:33.157610 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.157513    2563 server.go:87] "Starting device plugin registration server"
Jul 28 22:04:33.157838 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.157825    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 22:04:33.157872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.157843    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 22:04:33.157976 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.157943    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 22:04:33.158094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.158025    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 22:04:33.158094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.158034    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 22:04:33.158776 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.158756    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 22:04:33.158870 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.158815    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.176062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.176040    2563 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2601 into the system container \"/system.slice\": <nil>"
Jul 28 22:04:33.237278 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.237252    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 22:04:33.239403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.237302    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 22:04:33.239403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.237327    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 22:04:33.239403 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.237367    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 22:04:33.240094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.240073    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:33.258146 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.258086    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.259019 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.259003    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.259107 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.259054    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.259107 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.259075    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.259107 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.259106    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.268729 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.268714    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.268776 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.268736    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-142.ec2.internal\": node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.296868 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.296847    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.337647 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.337622    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"]
Jul 28 22:04:33.337750 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.337695    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.339253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.339237    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.339325 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.339269    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.339325 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.339278    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.341567 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.341554    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.341714 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.341700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.341795 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.341734    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.342269 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342252    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.342339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342273    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.342339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342285    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.342339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342254    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.342445 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342350    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.342445 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.342362    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.344658 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.344639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.344737 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.344670    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:33.345316 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.345300    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:33.345396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.345325    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:33.345396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.345336    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:33.360113 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.360094    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-142.ec2.internal\" not found" node="ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.363418 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.363403    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-142.ec2.internal\" not found" node="ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.397049 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.397030    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.403860 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.403840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.403934 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.403862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f12b46d1950955bc6884ff5ac3c8c404-config\") pod \"kube-apiserver-proxy-ip-10-0-133-142.ec2.internal\" (UID: \"f12b46d1950955bc6884ff5ac3c8c404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.403934 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.403880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.497536 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.497498    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.504913 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.504885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.505034 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.504922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.505034 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.504972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.505034 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.504976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab14e603e28189365da9a7adafc8be56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal\" (UID: \"ab14e603e28189365da9a7adafc8be56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.505034 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.505025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f12b46d1950955bc6884ff5ac3c8c404-config\") pod \"kube-apiserver-proxy-ip-10-0-133-142.ec2.internal\" (UID: \"f12b46d1950955bc6884ff5ac3c8c404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.505176 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.505053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f12b46d1950955bc6884ff5ac3c8c404-config\") pod \"kube-apiserver-proxy-ip-10-0-133-142.ec2.internal\" (UID: \"f12b46d1950955bc6884ff5ac3c8c404\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.598352 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.598259    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.662804 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.662777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.666505 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:33.666490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:33.698975 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.698955    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.799557 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.799523    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:33.900179 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:33.900097    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:34.000644 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:34.000613    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:34.026168 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.026135    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 22:04:34.026314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.026295    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 22:04:34.101039 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:34.101006    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:34.115289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.115256    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 21:59:33 +0000 UTC" deadline="2028-03-05 12:48:45.55546791 +0000 UTC"
Jul 28 22:04:34.115289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.115286    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14054h44m11.440186988s"
Jul 28 22:04:34.201662 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:34.201558    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-142.ec2.internal\" not found"
Jul 28 22:04:34.232834 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:34.232793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab14e603e28189365da9a7adafc8be56.slice/crio-58c6dd0e97d9c0cbe81b0c0a928552c66f355a30a7abe521a45ead59edcfc041 WatchSource:0}: Error finding container 58c6dd0e97d9c0cbe81b0c0a928552c66f355a30a7abe521a45ead59edcfc041: Status 404 returned error can't find the container with id 58c6dd0e97d9c0cbe81b0c0a928552c66f355a30a7abe521a45ead59edcfc041
Jul 28 22:04:34.240010 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.239993    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:04:34.241473 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.241366    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:34.241566 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.241516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal" event={"ID":"ab14e603e28189365da9a7adafc8be56","Type":"ContainerStarted","Data":"58c6dd0e97d9c0cbe81b0c0a928552c66f355a30a7abe521a45ead59edcfc041"}
Jul 28 22:04:34.248716 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:34.248690    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12b46d1950955bc6884ff5ac3c8c404.slice/crio-c1ccdf5338bcae5c09fdcd558395cbcc6fde754d7406905e514c4102380b1380 WatchSource:0}: Error finding container c1ccdf5338bcae5c09fdcd558395cbcc6fde754d7406905e514c4102380b1380: Status 404 returned error can't find the container with id c1ccdf5338bcae5c09fdcd558395cbcc6fde754d7406905e514c4102380b1380
Jul 28 22:04:34.302852 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.302805    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:34.316384 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.316352    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 22:04:34.319965 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.319939    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal"
Jul 28 22:04:34.329484 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.329466    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 22:04:34.342822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.342801    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:34.701463 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:34.701386    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:35.077164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.077080    2563 apiserver.go:52] "Watching apiserver"
Jul 28 22:04:35.086807 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.086780    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 22:04:35.088170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.088140    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d2tsm","kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j","openshift-cluster-node-tuning-operator/tuned-f7l7d","openshift-dns/node-resolver-kvwrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal","openshift-multus/multus-phxgz","openshift-multus/network-metrics-daemon-b88t2","kube-system/konnectivity-agent-5j24t","openshift-image-registry/node-ca-gn6w4","openshift-multus/multus-additional-cni-plugins-4nw82","openshift-network-diagnostics/network-check-target-xvhcx","openshift-network-operator/iptables-alerter-6qfcz","openshift-ovn-kubernetes/ovnkube-node-jndbt"]
Jul 28 22:04:35.090873 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.090845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.093144 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.093117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.094056 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.093971    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 22:04:35.094056 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.093998    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.094201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.094095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-57bs2\""
Jul 28 22:04:35.094201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.094019    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.095692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.095523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.095692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.095684    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4bzzl\""
Jul 28 22:04:35.095845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.095765    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.096078 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.096056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.096175 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.096064    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 22:04:35.097866 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.097847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.098005 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.097937    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:35.098236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.098216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.098877 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.098796    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.098992 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.098946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pwb2t\""
Jul 28 22:04:35.100322 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.100298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.101092 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.101074    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 22:04:35.103239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.102668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.103239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.102830    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmsjt\""
Jul 28 22:04:35.103239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.103177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.103239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.103207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.105241 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.105222    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.105346 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.105330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.105346 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.105330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:35.105862 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.105839    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.105966 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.105914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbzkj\""
Jul 28 22:04:35.106039 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.105962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 22:04:35.106039 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.106032    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 22:04:35.108686 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.108658    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.111427 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.111405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.111775 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.111752    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 22:04:35.112016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.111952    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 22:04:35.112094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.112061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xff8v\""
Jul 28 22:04:35.113969 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.113947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ldvzz\""
Jul 28 22:04:35.114134 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.114115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.114250 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.114232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 22:04:35.114611 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.114579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.114905 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.114888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.115335 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115315    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 22:04:35.115539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-os-release\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.115654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-run\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-lib-modules\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-var-lib-kubelet\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-host\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-hosts-file\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.115846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.115846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-modprobe-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-tuned\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.115846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-socket-dir-parent\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-hostroot\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsnhq\" (UniqueName: \"kubernetes.io/projected/24492970-e530-41b4-bf00-7a2d92bede63-kube-api-access-hsnhq\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysconfig\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.115981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-system-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-netns\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-conf-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034e0649-6338-4b99-a163-c35353acaa65-host\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.116104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24492970-e530-41b4-bf00-7a2d92bede63-host-slash\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-conf\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-kubelet-config\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cni-binary-copy\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-bin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-multus\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ntsg\" (UniqueName: \"kubernetes.io/projected/034e0649-6338-4b99-a163-c35353acaa65-kube-api-access-9ntsg\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24492970-e530-41b4-bf00-7a2d92bede63-iptables-alerter-script\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-kubernetes\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cnibin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-k8s-cni-cncf-io\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.116551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-daemon-config\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.117158 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.116557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:35.117158 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.116641    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:35.117158 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-systemd\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.117320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-tmp\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.117320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjmg\" (UniqueName: \"kubernetes.io/projected/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-kube-api-access-ccjmg\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.117320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-dbus\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.117320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-multus-certs\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.117320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-etc-kubernetes\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-sys\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-tmp-dir\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczrk\" (UniqueName: \"kubernetes.io/projected/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-kube-api-access-cczrk\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117505    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 22:04:35.117575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-kubelet\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.117893 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp76n\" (UniqueName: \"kubernetes.io/projected/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-kube-api-access-qp76n\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.117893 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dtfkc\""
Jul 28 22:04:35.117893 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034e0649-6338-4b99-a163-c35353acaa65-serviceca\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.117893 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.117415    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 22:04:35.119264 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.119247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.121811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.121787    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 22:04:35.122096 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.122077    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 22:04:35.122246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.122230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 22:04:35.122344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.122327    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 22:04:35.122407 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.122368    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 22:04:35.123928 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.123908    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jlvdh\""
Jul 28 22:04:35.124032 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.123909    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 22:04:35.136345 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.136310    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kblwx"
Jul 28 22:04:35.145215 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.145197    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kblwx"
Jul 28 22:04:35.203263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.203235    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 22:04:35.217908 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.217876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.217913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-sys\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.217934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-node-log\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.217970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-config\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-registration-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-tmp-dir\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-sys\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218076 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034e0649-6338-4b99-a163-c35353acaa65-serviceca\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-system-cni-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-os-release\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-lib-modules\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-host\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-os-release\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-modprobe-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-tuned\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-lib-modules\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-netns\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-modprobe-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.218457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-device-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-os-release\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-tmp-dir\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.218519    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-host\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.218617    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:04:35.718592795 +0000 UTC m=+3.030831789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218656    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-netns\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-slash\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-netns\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034e0649-6338-4b99-a163-c35353acaa65-serviceca\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flq7b\" (UniqueName: \"kubernetes.io/projected/6d0eaa6e-037f-449e-a177-9238bffa563e-kube-api-access-flq7b\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0dd850ee-d2de-474b-b301-2f52ce94c782-agent-certs\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54z9g\" (UniqueName: \"kubernetes.io/projected/8606d73a-c2af-4cf8-b66a-09e29cd21571-kube-api-access-54z9g\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cni-binary-copy\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24492970-e530-41b4-bf00-7a2d92bede63-iptables-alerter-script\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.219317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.218992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovn-node-metrics-cert\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-cnibin\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-kubernetes\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-systemd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-netd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24492970-e530-41b4-bf00-7a2d92bede63-iptables-alerter-script\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0dd850ee-d2de-474b-b301-2f52ce94c782-konnectivity-ca\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-kubernetes\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-systemd\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjmg\" (UniqueName: \"kubernetes.io/projected/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-kube-api-access-ccjmg\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cni-binary-copy\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-dbus\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cczrk\" (UniqueName: \"kubernetes.io/projected/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-kube-api-access-cczrk\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.220042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.219973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-systemd\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-kubelet\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp76n\" (UniqueName: \"kubernetes.io/projected/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-kube-api-access-qp76n\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-kubelet\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-dbus\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-systemd-units\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-kubelet\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-run\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-var-lib-kubelet\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-run\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-d\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-hosts-file\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-var-lib-kubelet\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-hosts-file\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsnhq\" (UniqueName: \"kubernetes.io/projected/24492970-e530-41b4-bf00-7a2d92bede63-kube-api-access-hsnhq\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-var-lib-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.220716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-bin\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-socket-dir-parent\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-hostroot\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-etc-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysconfig\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-hostroot\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-socket-dir-parent\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-system-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysconfig\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-conf-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034e0649-6338-4b99-a163-c35353acaa65-host\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-system-cni-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-conf-dir\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034e0649-6338-4b99-a163-c35353acaa65-host\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24492970-e530-41b4-bf00-7a2d92bede63-host-slash\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24492970-e530-41b4-bf00-7a2d92bede63-host-slash\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn72t\" (UniqueName: \"kubernetes.io/projected/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-kube-api-access-jn72t\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.221528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-conf\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-kubelet-config\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-bin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-sysctl-conf\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-multus\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-bin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntsg\" (UniqueName: \"kubernetes.io/projected/034e0649-6338-4b99-a163-c35353acaa65-kube-api-access-9ntsg\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-var-lib-cni-multus\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-ovn\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/05546884-8e52-4881-9871-8860567436dd-kubelet-config\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-env-overrides\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-script-lib\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cnibin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-k8s-cni-cncf-io\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.220977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-daemon-config\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-log-socket\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.222115 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-cnibin\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-k8s-cni-cncf-io\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-socket-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-sys-fs\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq25m\" (UniqueName: \"kubernetes.io/projected/0c28ea07-daf4-4e79-acac-455738d9243d-kube-api-access-nq25m\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-tmp\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-multus-certs\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-etc-kubernetes\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-host-run-multus-certs\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-etc-kubernetes\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.221517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-multus-daemon-config\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.223017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.222465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-etc-tuned\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.223707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.223070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-tmp\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.234033 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.232698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp76n\" (UniqueName: \"kubernetes.io/projected/7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f-kube-api-access-qp76n\") pod \"multus-phxgz\" (UID: \"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f\") " pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.234181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.233927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ntsg\" (UniqueName: \"kubernetes.io/projected/034e0649-6338-4b99-a163-c35353acaa65-kube-api-access-9ntsg\") pod \"node-ca-gn6w4\" (UID: \"034e0649-6338-4b99-a163-c35353acaa65\") " pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.234258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.233959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjmg\" (UniqueName: \"kubernetes.io/projected/d452c5ee-3d20-4d79-b2f5-ed4a5898dda7-kube-api-access-ccjmg\") pod \"tuned-f7l7d\" (UID: \"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7\") " pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.234318 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.234263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczrk\" (UniqueName: \"kubernetes.io/projected/a87dbd61-29cd-42e8-8ef8-3cfd9858beea-kube-api-access-cczrk\") pod \"node-resolver-kvwrj\" (UID: \"a87dbd61-29cd-42e8-8ef8-3cfd9858beea\") " pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.234580 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.233938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsnhq\" (UniqueName: \"kubernetes.io/projected/24492970-e530-41b4-bf00-7a2d92bede63-kube-api-access-hsnhq\") pod \"iptables-alerter-6qfcz\" (UID: \"24492970-e530-41b4-bf00-7a2d92bede63\") " pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.243824 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.243782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal" event={"ID":"f12b46d1950955bc6884ff5ac3c8c404","Type":"ContainerStarted","Data":"c1ccdf5338bcae5c09fdcd558395cbcc6fde754d7406905e514c4102380b1380"}
Jul 28 22:04:35.321571 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321571 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovn-node-metrics-cert\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-cnibin\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-systemd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-netd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0dd850ee-d2de-474b-b301-2f52ce94c782-konnectivity-ca\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.321826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-kubelet\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-systemd-units\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-netd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-var-lib-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-bin\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-etc-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-etc-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn72t\" (UniqueName: \"kubernetes.io/projected/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-kube-api-access-jn72t\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-var-lib-openvswitch\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-ovn\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-cni-bin\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-env-overrides\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-script-lib\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-kubelet\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.322313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-cnibin\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.321952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-systemd\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-log-socket\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-log-socket\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-socket-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-sys-fs\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq25m\" (UniqueName: \"kubernetes.io/projected/0c28ea07-daf4-4e79-acac-455738d9243d-kube-api-access-nq25m\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-node-log\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-config\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-registration-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0dd850ee-d2de-474b-b301-2f52ce94c782-konnectivity-ca\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-system-cni-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-system-cni-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.323189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-netns\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-device-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-os-release\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-run-ovn\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-slash\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-registration-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-binary-copy\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-systemd-units\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flq7b\" (UniqueName: \"kubernetes.io/projected/6d0eaa6e-037f-449e-a177-9238bffa563e-kube-api-access-flq7b\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-node-log\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0dd850ee-d2de-474b-b301-2f52ce94c782-agent-certs\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54z9g\" (UniqueName: \"kubernetes.io/projected/8606d73a-c2af-4cf8-b66a-09e29cd21571-kube-api-access-54z9g\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.322966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-env-overrides\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-device-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.324005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-socket-dir\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c28ea07-daf4-4e79-acac-455738d9243d-sys-fs\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-script-lib\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-slash\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-os-release\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-host-run-netns\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.323412    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.323484    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:04:35.823463252 +0000 UTC m=+3.135702246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8606d73a-c2af-4cf8-b66a-09e29cd21571-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovnkube-config\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.323893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.324348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8606d73a-c2af-4cf8-b66a-09e29cd21571-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.324707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.324590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-ovn-node-metrics-cert\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.325788 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.325762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0dd850ee-d2de-474b-b301-2f52ce94c782-agent-certs\") pod \"konnectivity-agent-5j24t\" (UID: \"0dd850ee-d2de-474b-b301-2f52ce94c782\") " pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.328640 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.328595    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:35.328640 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.328618    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:35.328640 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.328628    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:35.328808 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.328703    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:04:35.828689117 +0000 UTC m=+3.140928101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:35.331028 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.330985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq25m\" (UniqueName: \"kubernetes.io/projected/0c28ea07-daf4-4e79-acac-455738d9243d-kube-api-access-nq25m\") pod \"aws-ebs-csi-driver-node-6dr4j\" (UID: \"0c28ea07-daf4-4e79-acac-455738d9243d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.331726 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.331701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn72t\" (UniqueName: \"kubernetes.io/projected/38354a2f-3bcb-4b48-99e1-e73aac0cb01e-kube-api-access-jn72t\") pod \"ovnkube-node-jndbt\" (UID: \"38354a2f-3bcb-4b48-99e1-e73aac0cb01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.333283 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.333241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flq7b\" (UniqueName: \"kubernetes.io/projected/6d0eaa6e-037f-449e-a177-9238bffa563e-kube-api-access-flq7b\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.333410 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.333388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54z9g\" (UniqueName: \"kubernetes.io/projected/8606d73a-c2af-4cf8-b66a-09e29cd21571-kube-api-access-54z9g\") pod \"multus-additional-cni-plugins-4nw82\" (UID: \"8606d73a-c2af-4cf8-b66a-09e29cd21571\") " pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.403512 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.403474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gn6w4"
Jul 28 22:04:35.408765 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.408444    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:35.411781 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.411753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qfcz"
Jul 28 22:04:35.421955 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.421913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f7l7d"
Jul 28 22:04:35.428798 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.428782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvwrj"
Jul 28 22:04:35.436723 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.436703    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phxgz"
Jul 28 22:04:35.443510 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.443487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:35.451501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.451476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j"
Jul 28 22:04:35.458467 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.458449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4nw82"
Jul 28 22:04:35.464318 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.464293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:04:35.725392 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.725314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:35.725537 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.725483    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:35.725579 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.725556    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:04:36.725536874 +0000 UTC m=+4.037775849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:35.826043 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.826007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:35.826210 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.826127    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:35.826210 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.826200    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:04:36.826185672 +0000 UTC m=+4.138424657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:35.927234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:35.927187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:35.927421 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.927336    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:35.927421 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.927365    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:35.927421 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.927378    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:35.927575 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:35.927438    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:04:36.927420097 +0000 UTC m=+4.239659090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:36.006447 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.006405    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38354a2f_3bcb_4b48_99e1_e73aac0cb01e.slice/crio-dfa3c4d7dfe2f8dc64e68f515cbdc127bb02baa26b4c1d1e1d63f77c7bdaaf40 WatchSource:0}: Error finding container dfa3c4d7dfe2f8dc64e68f515cbdc127bb02baa26b4c1d1e1d63f77c7bdaaf40: Status 404 returned error can't find the container with id dfa3c4d7dfe2f8dc64e68f515cbdc127bb02baa26b4c1d1e1d63f77c7bdaaf40
Jul 28 22:04:36.011227 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.011201    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd850ee_d2de_474b_b301_2f52ce94c782.slice/crio-be8c6f92918160af648cc28c6e1d82c0c9ba1fe85b3c83182f5f835166e2cbb9 WatchSource:0}: Error finding container be8c6f92918160af648cc28c6e1d82c0c9ba1fe85b3c83182f5f835166e2cbb9: Status 404 returned error can't find the container with id be8c6f92918160af648cc28c6e1d82c0c9ba1fe85b3c83182f5f835166e2cbb9
Jul 28 22:04:36.012483 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.012455    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24492970_e530_41b4_bf00_7a2d92bede63.slice/crio-6e547addea1a22e118a6ade63cecaacc508c3de2d469f9aae7eaa3b44578f19a WatchSource:0}: Error finding container 6e547addea1a22e118a6ade63cecaacc508c3de2d469f9aae7eaa3b44578f19a: Status 404 returned error can't find the container with id 6e547addea1a22e118a6ade63cecaacc508c3de2d469f9aae7eaa3b44578f19a
Jul 28 22:04:36.014011 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.013986    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8606d73a_c2af_4cf8_b66a_09e29cd21571.slice/crio-c69d0b125de760c8d8be6f1179b24b690d923a1dc9effc3f37ab48abf9bccd88 WatchSource:0}: Error finding container c69d0b125de760c8d8be6f1179b24b690d923a1dc9effc3f37ab48abf9bccd88: Status 404 returned error can't find the container with id c69d0b125de760c8d8be6f1179b24b690d923a1dc9effc3f37ab48abf9bccd88
Jul 28 22:04:36.014899 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.014706    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd452c5ee_3d20_4d79_b2f5_ed4a5898dda7.slice/crio-f7dde7bf2fe0d8c2a75440deda9a4bf3174f5835e99043a3693fe0a95c937e68 WatchSource:0}: Error finding container f7dde7bf2fe0d8c2a75440deda9a4bf3174f5835e99043a3693fe0a95c937e68: Status 404 returned error can't find the container with id f7dde7bf2fe0d8c2a75440deda9a4bf3174f5835e99043a3693fe0a95c937e68
Jul 28 22:04:36.016430 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.016209    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87dbd61_29cd_42e8_8ef8_3cfd9858beea.slice/crio-6946d4e91ede2f4a832eca3307a51c7d12d9b3b4b6422ca01fcc2327c8185527 WatchSource:0}: Error finding container 6946d4e91ede2f4a832eca3307a51c7d12d9b3b4b6422ca01fcc2327c8185527: Status 404 returned error can't find the container with id 6946d4e91ede2f4a832eca3307a51c7d12d9b3b4b6422ca01fcc2327c8185527
Jul 28 22:04:36.019689 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.019652    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034e0649_6338_4b99_a163_c35353acaa65.slice/crio-6887f72c0eede227dbdd438be4dee40810939764a211a51a273ff12d21291bee WatchSource:0}: Error finding container 6887f72c0eede227dbdd438be4dee40810939764a211a51a273ff12d21291bee: Status 404 returned error can't find the container with id 6887f72c0eede227dbdd438be4dee40810939764a211a51a273ff12d21291bee
Jul 28 22:04:36.020415 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:04:36.020386    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c28ea07_daf4_4e79_acac_455738d9243d.slice/crio-e2e8ed38f7f25e97b86c6588ee0f0beeb9355e15dbf2121ad376040e7ea864f7 WatchSource:0}: Error finding container e2e8ed38f7f25e97b86c6588ee0f0beeb9355e15dbf2121ad376040e7ea864f7: Status 404 returned error can't find the container with id e2e8ed38f7f25e97b86c6588ee0f0beeb9355e15dbf2121ad376040e7ea864f7
Jul 28 22:04:36.149243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.149171    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 21:59:35 +0000 UTC" deadline="2028-02-11 14:29:18.01396953 +0000 UTC"
Jul 28 22:04:36.149243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.149237    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13504h24m41.864735424s"
Jul 28 22:04:36.238283 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.238247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:36.238468 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.238380    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:36.238468 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.238443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:36.238589 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.238567    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:36.247302 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.247272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5j24t" event={"ID":"0dd850ee-d2de-474b-b301-2f52ce94c782","Type":"ContainerStarted","Data":"be8c6f92918160af648cc28c6e1d82c0c9ba1fe85b3c83182f5f835166e2cbb9"}
Jul 28 22:04:36.248748 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.248714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"dfa3c4d7dfe2f8dc64e68f515cbdc127bb02baa26b4c1d1e1d63f77c7bdaaf40"}
Jul 28 22:04:36.250145 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.250117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j" event={"ID":"0c28ea07-daf4-4e79-acac-455738d9243d","Type":"ContainerStarted","Data":"e2e8ed38f7f25e97b86c6588ee0f0beeb9355e15dbf2121ad376040e7ea864f7"}
Jul 28 22:04:36.251397 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.251370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gn6w4" event={"ID":"034e0649-6338-4b99-a163-c35353acaa65","Type":"ContainerStarted","Data":"6887f72c0eede227dbdd438be4dee40810939764a211a51a273ff12d21291bee"}
Jul 28 22:04:36.253301 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.253234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7l7d" event={"ID":"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7","Type":"ContainerStarted","Data":"f7dde7bf2fe0d8c2a75440deda9a4bf3174f5835e99043a3693fe0a95c937e68"}
Jul 28 22:04:36.256494 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.256457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal" event={"ID":"f12b46d1950955bc6884ff5ac3c8c404","Type":"ContainerStarted","Data":"bc689e7af0694a9c36d95cfcb908eede9d75ff1b977870c5013138f4a3edd47b"}
Jul 28 22:04:36.257904 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.257874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phxgz" event={"ID":"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f","Type":"ContainerStarted","Data":"db97308242bddbe1b550aadf2d56b318875465d4aa6b5e127910329a943fbe0a"}
Jul 28 22:04:36.259208 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.259172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvwrj" event={"ID":"a87dbd61-29cd-42e8-8ef8-3cfd9858beea","Type":"ContainerStarted","Data":"6946d4e91ede2f4a832eca3307a51c7d12d9b3b4b6422ca01fcc2327c8185527"}
Jul 28 22:04:36.260422 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.260389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerStarted","Data":"c69d0b125de760c8d8be6f1179b24b690d923a1dc9effc3f37ab48abf9bccd88"}
Jul 28 22:04:36.261598 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.261558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qfcz" event={"ID":"24492970-e530-41b4-bf00-7a2d92bede63","Type":"ContainerStarted","Data":"6e547addea1a22e118a6ade63cecaacc508c3de2d469f9aae7eaa3b44578f19a"}
Jul 28 22:04:36.278328 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.278282    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-142.ec2.internal" podStartSLOduration=2.278269944 podStartE2EDuration="2.278269944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:36.277839742 +0000 UTC m=+3.590078737" watchObservedRunningTime="2026-07-28 22:04:36.278269944 +0000 UTC m=+3.590508939"
Jul 28 22:04:36.734410 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.734032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:36.734410 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.734348    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:36.734644 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.734430    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:04:38.734404983 +0000 UTC m=+6.046643976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:36.835542 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.834724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:36.835542 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.834932    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:36.835542 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.835013    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:04:38.83499287 +0000 UTC m=+6.147231844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:36.935487 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:36.935443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:36.935713 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.935676    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:36.935713 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.935701    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:36.935713 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.935714    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:36.935897 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:36.935778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:04:38.935758349 +0000 UTC m=+6.247997325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:37.150104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:37.150006    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 21:59:35 +0000 UTC" deadline="2028-02-20 01:47:50.848150086 +0000 UTC"
Jul 28 22:04:37.150104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:37.150052    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13707h43m13.698102941s"
Jul 28 22:04:37.240605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:37.240572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:37.240814 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:37.240732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:38.239096 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:38.238319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:38.239096 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.238463    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:38.239096 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:38.238895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:38.239096 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.239011    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:38.756940 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:38.756889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:38.757175 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.757154    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:38.757266 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.757237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:04:42.757214562 +0000 UTC m=+10.069453546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:38.857490 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:38.857441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:38.857733 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.857715    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:38.857816 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.857790    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:04:42.857769811 +0000 UTC m=+10.170008786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:38.958736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:38.958690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:38.958937 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.958880    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:38.958937 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.958898    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:38.958937 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.958911    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:38.959109 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:38.958976    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:04:42.958956693 +0000 UTC m=+10.271195688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:39.239321 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:39.238773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:39.239321 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:39.238919    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:40.238136 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:40.238097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:40.238348 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:40.238269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:40.238348 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:40.238306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:40.238463 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:40.238427    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:41.241188 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:41.240583    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:41.241188 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:41.240764    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:42.238465 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:42.238340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:42.238749 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.238497    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:42.238749 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:42.238562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:42.238749 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.238721    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:42.790800 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:42.790760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:42.791230 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.790933    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:42.791230 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.791009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:04:50.790988354 +0000 UTC m=+18.103227339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:42.891407 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:42.891358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:42.891621 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.891554    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:42.891691 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.891655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:04:50.891634386 +0000 UTC m=+18.203873379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:42.992281 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:42.992239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:42.992465 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.992402    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:42.992465 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.992425    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:42.992465 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.992437    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:42.992626 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:42.992497    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:04:50.992473951 +0000 UTC m=+18.304712939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:43.239235 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:43.239203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:43.239409 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:43.239310    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:44.238391 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:44.237740    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:44.238391 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:44.237888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:44.238391 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:44.238258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:44.238391 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:44.238345    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:45.237835 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:45.237700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:45.238017 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:45.237845    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:46.237861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:46.237825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:46.237861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:46.237859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:46.238314 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:46.237980    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:46.238314 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:46.238070    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:47.237867 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:47.237833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:47.238344 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:47.237972    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:48.237982 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:48.237945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:48.238438 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:48.237953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:48.238438 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:48.238090    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:48.238438 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:48.238211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:49.241679 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:49.238705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:49.241679 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:49.238992    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:50.238207 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:50.238167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:50.238465 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:50.238224    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:50.238465 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.238309    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:50.238550 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.238459    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:50.854420 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:50.854386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:50.854874 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.854545    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:50.854874 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.854630    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:05:06.854609707 +0000 UTC m=+34.166848680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:04:50.955304 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:50.955270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:50.955483 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.955408    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:50.955529 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:50.955487    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:05:06.955466401 +0000 UTC m=+34.267705375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:04:51.056313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:51.056282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:51.056489 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:51.056472    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:04:51.056565 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:51.056496    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:04:51.056565 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:51.056509    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:51.056683 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:51.056573    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:07.056554115 +0000 UTC m=+34.368793116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:04:51.240227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:51.240199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:51.240370 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:51.240295    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:52.238211 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:52.238173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:52.238675 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:52.238289    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:52.238675 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:52.238348    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:52.238675 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:52.238491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:53.240674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:53.240644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:53.241114 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:53.240759    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:54.237832 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:54.237794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:54.238007 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:54.237918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:54.238007 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:54.237983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:54.238132 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:54.238106    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:55.239508 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:55.239035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:55.239508 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:55.239174    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:56.238496 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.238154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:56.238662 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.238165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:56.238718 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:56.238677    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:56.238824 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:56.238804    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:56.335280 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.335237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phxgz" event={"ID":"7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f","Type":"ContainerStarted","Data":"e7b20d1fb97728fb072198b54cdb70bb99885dc0afeda3f228f4a112d9626465"}
Jul 28 22:04:56.336984 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.336909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvwrj" event={"ID":"a87dbd61-29cd-42e8-8ef8-3cfd9858beea","Type":"ContainerStarted","Data":"cda56f6344185e93239573a2bb5f03b0a1bd9bc136bc59141273eaa2cb239e3f"}
Jul 28 22:04:56.338709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.338679    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="9c454daf238c8316cf4bc671d0344b58ed8fdfa58674f1d04192088c4bc5dcb4" exitCode=0
Jul 28 22:04:56.338842 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.338775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"9c454daf238c8316cf4bc671d0344b58ed8fdfa58674f1d04192088c4bc5dcb4"}
Jul 28 22:04:56.340512 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.340479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5j24t" event={"ID":"0dd850ee-d2de-474b-b301-2f52ce94c782","Type":"ContainerStarted","Data":"21ec7207385cf8ddc7c9437284ef4c5c046fa87ceb428ded94b2a0700f5e8fa4"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"8a0a00502962f6cbf98202d02d40c63e8617bc385291aeb0cc0b101b02156128"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"c6d1267828b95ae2c207b85f6c2db35fb6744ffff1b3d6b7ff466d0e04616632"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"183094c6b892bdcd7c0ac5236289080b57c740171c82aa561816ee2bc73ac5a5"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"29f6930347f81d5c61f6524a0939ecbd6663673562ceadf7ada455c749309830"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"e0c141d2cf2d48aa544b571812767371e0d8888930d09cf1367c3cafe2f85c1f"}
Jul 28 22:04:56.344453 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.344447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"97a72cf775593b800e3d6e785ca952d4ad0355f6bb93b8c7de64841e6e9f8fc9"}
Jul 28 22:04:56.345851 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.345823    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab14e603e28189365da9a7adafc8be56" containerID="1f9447d00b8b7f342d251c1e6d175bd826a5cdd4b333b761a47db42fed5dac56" exitCode=0
Jul 28 22:04:56.345949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.345916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal" event={"ID":"ab14e603e28189365da9a7adafc8be56","Type":"ContainerDied","Data":"1f9447d00b8b7f342d251c1e6d175bd826a5cdd4b333b761a47db42fed5dac56"}
Jul 28 22:04:56.347626 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.347604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j" event={"ID":"0c28ea07-daf4-4e79-acac-455738d9243d","Type":"ContainerStarted","Data":"34c5f26c2ba50772a658c9059976124ed910aafa9b6ce07e28918e55eb329cad"}
Jul 28 22:04:56.348997 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.348978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gn6w4" event={"ID":"034e0649-6338-4b99-a163-c35353acaa65","Type":"ContainerStarted","Data":"8ed5af0b8e330e0ad95f8198bccd48ba9d71cd2df0708f9150d5b77f6f5d4211"}
Jul 28 22:04:56.350474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.350444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f7l7d" event={"ID":"d452c5ee-3d20-4d79-b2f5-ed4a5898dda7","Type":"ContainerStarted","Data":"4ff1ecee97a9ea4fa33270bd738a9bc45cba51cf740d47820d923b4a4cd273dc"}
Jul 28 22:04:56.355288 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.355252    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-phxgz" podStartSLOduration=3.137721263 podStartE2EDuration="22.355240423s" totalImagesPullingTime="19.21751916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:56.354870527 +0000 UTC m=+23.667109519" watchObservedRunningTime="2026-07-28 22:04:56.355240423 +0000 UTC m=+23.667479414"
Jul 28 22:04:56.390930 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.390878    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f7l7d" podStartSLOduration=3.195352204 podStartE2EDuration="22.390859125s" totalImagesPullingTime="19.195506921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:56.390660184 +0000 UTC m=+23.702899177" watchObservedRunningTime="2026-07-28 22:04:56.390859125 +0000 UTC m=+23.703098117"
Jul 28 22:04:56.409104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.409050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gn6w4" podStartSLOduration=4.253668932 podStartE2EDuration="23.409033029s" totalImagesPullingTime="19.155364097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:56.40846951 +0000 UTC m=+23.720708500" watchObservedRunningTime="2026-07-28 22:04:56.409033029 +0000 UTC m=+23.721272020"
Jul 28 22:04:56.428618 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.428553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kvwrj" podStartSLOduration=3.248447125 podStartE2EDuration="22.42853724s" totalImagesPullingTime="19.180090115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:56.427819489 +0000 UTC m=+23.740058480" watchObservedRunningTime="2026-07-28 22:04:56.42853724 +0000 UTC m=+23.740776230"
Jul 28 22:04:56.455417 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.455369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5j24t" podStartSLOduration=7.290206758 podStartE2EDuration="22.455344825s" totalImagesPullingTime="15.165138067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:56.455218884 +0000 UTC m=+23.767457874" watchObservedRunningTime="2026-07-28 22:04:56.455344825 +0000 UTC m=+23.767583816"
Jul 28 22:04:56.797017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.796980    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:56.797667 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.797649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:56.907750 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:56.907716    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 22:04:57.170381 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.170219    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T22:04:56.90774294Z","UUID":"3dc45670-b220-4c73-bcba-ba43b0f977c4","Handler":null,"Name":"","Endpoint":""}
Jul 28 22:04:57.171836 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.171807    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 22:04:57.171970 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.171852    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 22:04:57.242501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.242476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:57.242701 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:57.242608    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:04:57.356232 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.356199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal" event={"ID":"ab14e603e28189365da9a7adafc8be56","Type":"ContainerStarted","Data":"e642d0b50341fabdbd5301ec5b4ef6f1d62ae1e96f2d28f78ae0bbe87fb3b3e9"}
Jul 28 22:04:57.358635 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.358611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j" event={"ID":"0c28ea07-daf4-4e79-acac-455738d9243d","Type":"ContainerStarted","Data":"76b87a7534deaed41b4c09af2200af7a36580028c53ecb5cdb3c1bb7cce27e8b"}
Jul 28 22:04:57.360327 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.360297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qfcz" event={"ID":"24492970-e530-41b4-bf00-7a2d92bede63","Type":"ContainerStarted","Data":"8c7e7d90ae9b59f6cc8229720183d28d4b147cb7a3fb25584c48cee4bf67301e"}
Jul 28 22:04:57.361349 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.361316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:57.361921 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.361904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5j24t"
Jul 28 22:04:57.386375 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.386319    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6qfcz" podStartSLOduration=5.201825824 podStartE2EDuration="24.386299862s" totalImagesPullingTime="19.184474038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:57.386249884 +0000 UTC m=+24.698488874" watchObservedRunningTime="2026-07-28 22:04:57.386299862 +0000 UTC m=+24.698538854"
Jul 28 22:04:57.386956 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:57.386905    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-142.ec2.internal" podStartSLOduration=23.386893689 podStartE2EDuration="23.386893689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:57.372199673 +0000 UTC m=+24.684438665" watchObservedRunningTime="2026-07-28 22:04:57.386893689 +0000 UTC m=+24.699132681"
Jul 28 22:04:58.238572 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:58.238537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:04:58.238803 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:58.238539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:04:58.238803 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:58.238752    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:04:58.238995 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:58.238878    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:04:58.369617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:58.369557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"00f88e7feaf1b2981aefaa180c11b2de4f6898ab1407a73265627d7fd4c257d9"}
Jul 28 22:04:58.371780 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:58.371711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j" event={"ID":"0c28ea07-daf4-4e79-acac-455738d9243d","Type":"ContainerStarted","Data":"6f6f0af72da8a4e25d887c5e305469670bc35cf8e5c718af2f17b7edc164ec9d"}
Jul 28 22:04:58.390817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:58.390761    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dr4j" podStartSLOduration=3.049956181 podStartE2EDuration="24.39073871s" totalImagesPullingTime="21.340782529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:04:58.390230647 +0000 UTC m=+25.702469675" watchObservedRunningTime="2026-07-28 22:04:58.39073871 +0000 UTC m=+25.702977701"
Jul 28 22:04:59.238202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:04:59.237984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:04:59.238507 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:04:59.238317    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:05:00.238555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:00.238468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:00.238555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:00.238497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:00.239067 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:00.238605    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:05:00.239067 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:00.238747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:05:01.237855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.237639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:01.238049 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:01.237909    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:05:01.382652 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.382614    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="a020554e4f181121cc34d2b51e6d8f890ddd68b355c8f7ed6a90a4515438f6db" exitCode=0
Jul 28 22:05:01.383451 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.382691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"a020554e4f181121cc34d2b51e6d8f890ddd68b355c8f7ed6a90a4515438f6db"}
Jul 28 22:05:01.386423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.386400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" event={"ID":"38354a2f-3bcb-4b48-99e1-e73aac0cb01e","Type":"ContainerStarted","Data":"1b1ba9cb5be4f0bf7f93247717fab5da639709c215460dbb0c6b726765c0f15c"}
Jul 28 22:05:01.386628 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.386611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:01.386685 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.386678    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:01.401861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.401838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:01.437936 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:01.437884    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt" podStartSLOduration=8.183107476 podStartE2EDuration="27.43786994s" totalImagesPullingTime="19.254762464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:01.436297355 +0000 UTC m=+28.748536345" watchObservedRunningTime="2026-07-28 22:05:01.43786994 +0000 UTC m=+28.750108931"
Jul 28 22:05:02.238518 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:02.238483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:02.238518 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:02.238520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:02.238808 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:02.238630    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:05:02.238808 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:02.238747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:05:02.389093 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:02.389059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:02.403689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:02.403655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:03.014890 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.014861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xvhcx"]
Jul 28 22:05:03.015075 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.014990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:03.015147 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:03.015127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:05:03.017331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.017302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b88t2"]
Jul 28 22:05:03.017452 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.017384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:03.017497 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:03.017465    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:05:03.020038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.020013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2tsm"]
Jul 28 22:05:03.020144 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.020121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:03.020222 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:03.020204    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:05:03.393199 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.393106    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="f91f87defe67c8cc2a9a53bac5470a945b3a0cf55e699c1fb88acee862ee4e0f" exitCode=0
Jul 28 22:05:03.393552 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:03.393204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"f91f87defe67c8cc2a9a53bac5470a945b3a0cf55e699c1fb88acee862ee4e0f"}
Jul 28 22:05:04.238512 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:04.238486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:04.238657 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:04.238616    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:05:05.238201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:05.238037    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:05.238785 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:05.238044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:05.238785 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:05.238271    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:05:05.238785 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:05.238342    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:05:05.399573 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:05.399540    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="87c879bb5f49aca24cd8153f9bb21966f316fb920d83b65ba36041e2fbbfde4f" exitCode=0
Jul 28 22:05:05.399747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:05.399594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"87c879bb5f49aca24cd8153f9bb21966f316fb920d83b65ba36041e2fbbfde4f"}
Jul 28 22:05:06.238235 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:06.238207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:06.238706 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:06.238305    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:05:06.875724 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:06.875683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:06.875897 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:06.875863    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:06.875957 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:06.875945    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret podName:05546884-8e52-4881-9871-8860567436dd nodeName:}" failed. No retries permitted until 2026-07-28 22:05:38.875922583 +0000 UTC m=+66.188161568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret") pod "global-pull-secret-syncer-d2tsm" (UID: "05546884-8e52-4881-9871-8860567436dd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:06.976814 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:06.976775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:06.976976 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:06.976941    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:06.977048 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:06.977009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:05:38.976987969 +0000 UTC m=+66.289226950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:07.077569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:07.077501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:07.077765 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.077718    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:07.077765 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.077746    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:07.077765 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.077760    2563 projected.go:196] Error preparing data for projected volume kube-api-access-bnxrm for pod openshift-network-diagnostics/network-check-target-xvhcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:07.077916 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.077829    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm podName:9d9a07e6-9038-4242-9194-14060be5e569 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:39.077809671 +0000 UTC m=+66.390048659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnxrm" (UniqueName: "kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm") pod "network-check-target-xvhcx" (UID: "9d9a07e6-9038-4242-9194-14060be5e569") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:07.237821 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:07.237789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:07.237821 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:07.237814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:07.238072 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.237941    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d2tsm" podUID="05546884-8e52-4881-9871-8860567436dd"
Jul 28 22:05:07.238072 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:07.238040    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xvhcx" podUID="9d9a07e6-9038-4242-9194-14060be5e569"
Jul 28 22:05:08.034791 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.034757    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-142.ec2.internal" event="NodeReady"
Jul 28 22:05:08.035227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.034921    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 22:05:08.070710 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.070638    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"]
Jul 28 22:05:08.073711 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.073682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.075279 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.075253    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:05:08.076504 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.076479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbvvm\""
Jul 28 22:05:08.076655 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.076479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 22:05:08.077195 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.077163    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 22:05:08.078729 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.078709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.081709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.081658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 22:05:08.081982 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.081933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8lc2p\""
Jul 28 22:05:08.082989 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.082794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 22:05:08.083071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.082992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 22:05:08.089657 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.089635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"]
Jul 28 22:05:08.091402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.090980    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6p7fl"]
Jul 28 22:05:08.091402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.091249    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 22:05:08.094718 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.094698    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl92"]
Jul 28 22:05:08.094861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.094839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.097998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.097976    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 22:05:08.097998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.097993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 22:05:08.098172 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.098150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:05:08.098272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.098158    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvh82\""
Jul 28 22:05:08.098272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.098226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.100866 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.100847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 22:05:08.101338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.101318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c8bjt\""
Jul 28 22:05:08.101439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.101326    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 22:05:08.101439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.101380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 22:05:08.107693 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.107673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p7fl"]
Jul 28 22:05:08.113037 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.112956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl92"]
Jul 28 22:05:08.188498 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlfj\" (UniqueName: \"kubernetes.io/projected/b1409118-44cf-4a04-b3a5-e1ef605d4e14-kube-api-access-2vlfj\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.188672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.188672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.188672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.188797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.188797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5mn\" (UniqueName: \"kubernetes.io/projected/d3101ed0-7847-42ba-82ff-5786a9b34859-kube-api-access-ng5mn\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.188898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1409118-44cf-4a04-b3a5-e1ef605d4e14-cert\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.188898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.188898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3101ed0-7847-42ba-82ff-5786a9b34859-config-volume\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.188898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3101ed0-7847-42ba-82ff-5786a9b34859-tmp-dir\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.189066 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.189066 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.189066 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.188985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.189174 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.189067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.189174 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.189101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtkq\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.189174 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.189153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.237720 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.237677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:08.241838 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.241810    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 22:05:08.241974 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.241952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5pt7\""
Jul 28 22:05:08.290099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5mn\" (UniqueName: \"kubernetes.io/projected/d3101ed0-7847-42ba-82ff-5786a9b34859-kube-api-access-ng5mn\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1409118-44cf-4a04-b3a5-e1ef605d4e14-cert\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3101ed0-7847-42ba-82ff-5786a9b34859-config-volume\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3101ed0-7847-42ba-82ff-5786a9b34859-tmp-dir\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290338 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.290335    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.290405    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:08.790385595 +0000 UTC m=+36.102624565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtkq\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlfj\" (UniqueName: \"kubernetes.io/projected/b1409118-44cf-4a04-b3a5-e1ef605d4e14-kube-api-access-2vlfj\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.290707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.290808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.290882    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.290951    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:08.790923804 +0000 UTC m=+36.103162774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.291080    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.291092    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:08.291248 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.291135    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:08.791122954 +0000 UTC m=+36.103361966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:08.291543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.291295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.291543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.291362    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.291817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.291799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3101ed0-7847-42ba-82ff-5786a9b34859-config-volume\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.291938 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.291915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3101ed0-7847-42ba-82ff-5786a9b34859-tmp-dir\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.292088 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.292032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.294845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.294821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.294845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.294836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.295057 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.294848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1409118-44cf-4a04-b3a5-e1ef605d4e14-cert\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.299114 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.299080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtkq\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.300243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.300151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlfj\" (UniqueName: \"kubernetes.io/projected/b1409118-44cf-4a04-b3a5-e1ef605d4e14-kube-api-access-2vlfj\") pod \"ingress-canary-rfl92\" (UID: \"b1409118-44cf-4a04-b3a5-e1ef605d4e14\") " pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.300243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.300235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5mn\" (UniqueName: \"kubernetes.io/projected/d3101ed0-7847-42ba-82ff-5786a9b34859-kube-api-access-ng5mn\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.300492 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.300460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.414726 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.414657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfl92"
Jul 28 22:05:08.794852 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.794817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:08.795038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.794865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:08.795038 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.794989    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:08.795038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:08.794988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795047    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.795029159 +0000 UTC m=+37.107268145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795080    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795097    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795113    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795159    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.79514772 +0000 UTC m=+37.107386689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:08.795193 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:08.795171    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.795165698 +0000 UTC m=+37.107404666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:09.238205 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.238082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:09.238881 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.238299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:09.242543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.242051    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 22:05:09.242543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.242325    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 22:05:09.242743 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.242609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 22:05:09.242790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.242755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65j7n\""
Jul 28 22:05:09.803102 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.803060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:09.803288 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.803226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:09.803288 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803232    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:09.803407 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:09.803294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:09.803407 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803316    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:11.803293384 +0000 UTC m=+39.115532368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:09.803407 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803391    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:09.803549 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803458    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:11.803440319 +0000 UTC m=+39.115679308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:09.803549 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803392    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:09.803549 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803487    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:09.803549 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:09.803529    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:11.803519631 +0000 UTC m=+39.115758601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:10.049238 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:10.049081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl92"]
Jul 28 22:05:10.053306 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:05:10.053228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1409118_44cf_4a04_b3a5_e1ef605d4e14.slice/crio-12f0526b5bc8a850047adbfce2f665ce0285a09ee0138db480a1dcb1771cca74 WatchSource:0}: Error finding container 12f0526b5bc8a850047adbfce2f665ce0285a09ee0138db480a1dcb1771cca74: Status 404 returned error can't find the container with id 12f0526b5bc8a850047adbfce2f665ce0285a09ee0138db480a1dcb1771cca74
Jul 28 22:05:10.411376 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:10.411285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfl92" event={"ID":"b1409118-44cf-4a04-b3a5-e1ef605d4e14","Type":"ContainerStarted","Data":"12f0526b5bc8a850047adbfce2f665ce0285a09ee0138db480a1dcb1771cca74"}
Jul 28 22:05:10.413749 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:10.413722    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="7c966957d366c051217af0b14f5a33706540af7079029acb0370c22558ccbaa7" exitCode=0
Jul 28 22:05:10.413876 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:10.413760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"7c966957d366c051217af0b14f5a33706540af7079029acb0370c22558ccbaa7"}
Jul 28 22:05:11.420208 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.420172    2563 generic.go:356] "Generic (PLEG): container finished" podID="8606d73a-c2af-4cf8-b66a-09e29cd21571" containerID="03024d7ed5df020257bbb3f2a7c045e58e93c9dd28953f3ee10163edd876c1c8" exitCode=0
Jul 28 22:05:11.420778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.420222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerDied","Data":"03024d7ed5df020257bbb3f2a7c045e58e93c9dd28953f3ee10163edd876c1c8"}
Jul 28 22:05:11.499794 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.499514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:11.587617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.587564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:11.661470 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.661379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:11.820760 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.820719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:11.820967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.820814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:11.820967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:11.820849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:11.820967 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.820888    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.820969    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:15.820947146 +0000 UTC m=+43.133186115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.820978    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.820984    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.821005    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.821028    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:15.821012803 +0000 UTC m=+43.133251772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:11.821125 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:11.821051    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:15.821034376 +0000 UTC m=+43.133273349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:12.390446 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.390408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:12.426398 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.426363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4nw82" event={"ID":"8606d73a-c2af-4cf8-b66a-09e29cd21571","Type":"ContainerStarted","Data":"8d912ab30e8490ed31e1a2a7d45674890e442df137153ab80c34392e0b96b9a0"}
Jul 28 22:05:12.427930 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.427904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfl92" event={"ID":"b1409118-44cf-4a04-b3a5-e1ef605d4e14","Type":"ContainerStarted","Data":"95a69aabf8a26b47794ac3d4b912ad5ee69c9f7ee5c662fb09de18c6af3469eb"}
Jul 28 22:05:12.453493 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.453436    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4nw82" podStartSLOduration=7.897652432 podStartE2EDuration="38.453419619s" totalImagesPullingTime="30.555767187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:12.45127915 +0000 UTC m=+39.763518141" watchObservedRunningTime="2026-07-28 22:05:12.453419619 +0000 UTC m=+39.765658609"
Jul 28 22:05:12.455735 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.455706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:12.591058 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.590958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:12.655769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:12.655735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:15.851016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:15.850977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:15.851016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:15.851019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851117    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:23.85115043 +0000 UTC m=+51.163389398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851181    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851201    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851246    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:23.851232365 +0000 UTC m=+51.163471334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:15.851297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851361    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:15.851485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:15.851386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:23.851379701 +0000 UTC m=+51.163618670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:21.752024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:21.751984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:21.953981 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:21.953949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:22.348065 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:22.348024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:22.746461 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:22.746429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:22.805269 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:22.805237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:23.911189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:23.911149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:23.911212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:23.911260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911312    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911351    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911357    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911395    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:39.911378318 +0000 UTC m=+67.223617286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911418    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:39.911404539 +0000 UTC m=+67.223643508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911363    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:23.911617 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:23.911447    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:39.911441257 +0000 UTC m=+67.223680226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:24.740202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:24.740169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:25.416598 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:25.416538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:25.528261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:25.528220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:27.363601 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:27.363551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:27.463631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:27.463601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:27.564347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:27.564286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:28.374151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:28.374118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:34.411721 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:34.411494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jndbt"
Jul 28 22:05:34.449290 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:34.449235    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rfl92" podStartSLOduration=24.291381950999998 podStartE2EDuration="26.449219271s" totalImagesPullingTime="2.15783732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:12.470441088 +0000 UTC m=+39.782680078" watchObservedRunningTime="2026-07-28 22:05:34.449219271 +0000 UTC m=+61.761458262"
Jul 28 22:05:34.539037 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:34.539002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:34.638917 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:34.638880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:34.740327 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:34.740292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:37.814044 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:37.814013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:37.886423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:37.886388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:38.129237 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.129142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:38.586062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.586026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:38.721301 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.721267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:38.927025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.926935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:38.930172 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.930153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 22:05:38.941438 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.941413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/05546884-8e52-4881-9871-8860567436dd-original-pull-secret\") pod \"global-pull-secret-syncer-d2tsm\" (UID: \"05546884-8e52-4881-9871-8860567436dd\") " pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:38.952423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:38.952400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d2tsm"
Jul 28 22:05:39.028169 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.027621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:05:39.030736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.030696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 22:05:39.038012 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.037995    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:05:39.038103 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.038067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:06:43.038043575 +0000 UTC m=+130.350282559 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : secret "metrics-daemon-secret" not found
Jul 28 22:05:39.074524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.074498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d2tsm"]
Jul 28 22:05:39.077995 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:05:39.077968    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05546884_8e52_4881_9871_8860567436dd.slice/crio-2970d1b09b808efaad46db90a0854190800e6eb428e61cef18bf39f4a38f3991 WatchSource:0}: Error finding container 2970d1b09b808efaad46db90a0854190800e6eb428e61cef18bf39f4a38f3991: Status 404 returned error can't find the container with id 2970d1b09b808efaad46db90a0854190800e6eb428e61cef18bf39f4a38f3991
Jul 28 22:05:39.128032 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.127986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:39.130928 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.130911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 22:05:39.141387 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.141369    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 22:05:39.152030 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.152002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxrm\" (UniqueName: \"kubernetes.io/projected/9d9a07e6-9038-4242-9194-14060be5e569-kube-api-access-bnxrm\") pod \"network-check-target-xvhcx\" (UID: \"9d9a07e6-9038-4242-9194-14060be5e569\") " pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:39.261107 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.261075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65j7n\""
Jul 28 22:05:39.268484 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.268467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:39.386594 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.386539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xvhcx"]
Jul 28 22:05:39.388404 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:05:39.388371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9a07e6_9038_4242_9194_14060be5e569.slice/crio-3914d767489624bb76b4a03efab5737c57ed70f9d8394038a5942d896e29371a WatchSource:0}: Error finding container 3914d767489624bb76b4a03efab5737c57ed70f9d8394038a5942d896e29371a: Status 404 returned error can't find the container with id 3914d767489624bb76b4a03efab5737c57ed70f9d8394038a5942d896e29371a
Jul 28 22:05:39.493529 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.493492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xvhcx" event={"ID":"9d9a07e6-9038-4242-9194-14060be5e569","Type":"ContainerStarted","Data":"3914d767489624bb76b4a03efab5737c57ed70f9d8394038a5942d896e29371a"}
Jul 28 22:05:39.494790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.494761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2tsm" event={"ID":"05546884-8e52-4881-9871-8860567436dd","Type":"ContainerStarted","Data":"2970d1b09b808efaad46db90a0854190800e6eb428e61cef18bf39f4a38f3991"}
Jul 28 22:05:39.935968 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.935927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:05:39.936456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.936008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:05:39.936456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:39.936074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:05:39.936456 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936116    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:05:39.936640 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936456    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:11.936419813 +0000 UTC m=+99.248658799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:05:39.936640 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936626    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:39.936760 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:11.936679825 +0000 UTC m=+99.248918796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:39.936760 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936712    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:05:39.936760 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936734    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:05:39.936911 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:05:39.936865    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:11.936847252 +0000 UTC m=+99.249086239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:05:42.562507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:42.562470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:42.662816 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:42.662776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:42.949447 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:42.949396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:43.050706 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:43.050671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:44.509333 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:44.509296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xvhcx" event={"ID":"9d9a07e6-9038-4242-9194-14060be5e569","Type":"ContainerStarted","Data":"5bcc53504c3a814b71748f677265eeadd301e467033b75c76b9cec4b8d05eb91"}
Jul 28 22:05:44.509827 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:44.509380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:05:44.510723 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:44.510700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d2tsm" event={"ID":"05546884-8e52-4881-9871-8860567436dd","Type":"ContainerStarted","Data":"a36bf87a903c8202e223a26e4aeeca62ad8cb11c16dae12a3b8fd1d668b410fc"}
Jul 28 22:05:44.526961 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:44.526912    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xvhcx" podStartSLOduration=66.173847718 podStartE2EDuration="1m10.52689761s" totalImagesPullingTime="4.353049892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:44.526282801 +0000 UTC m=+71.838521795" watchObservedRunningTime="2026-07-28 22:05:44.52689761 +0000 UTC m=+71.839136598"
Jul 28 22:05:44.542619 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:44.542544    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d2tsm" podStartSLOduration=65.874660394 podStartE2EDuration="1m10.542527258s" totalImagesPullingTime="4.667866864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:44.542133555 +0000 UTC m=+71.854372560" watchObservedRunningTime="2026-07-28 22:05:44.542527258 +0000 UTC m=+71.854766248"
Jul 28 22:05:59.785367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:59.785246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:05:59.918738 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:05:59.918701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:06:03.396213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:03.396180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:06:03.445623 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:03.445561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:06:11.977276 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:11.977217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:11.977288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977365    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977387    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977388    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:07:15.977438997 +0000 UTC m=+163.289677966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977536    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:07:15.977503966 +0000 UTC m=+163.289742948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:11.977606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977685    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:06:11.977838 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:11.977729    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:07:15.977720781 +0000 UTC m=+163.289959752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:06:15.515765 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:15.515732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xvhcx"
Jul 28 22:06:35.822235 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:35.822194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:06:35.900048 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:35.900006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:06:43.093645 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:06:43.093611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:06:43.094170 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:43.093732    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:06:43.094170 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:06:43.093838    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:08:45.093789747 +0000 UTC m=+252.406028733 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : secret "metrics-daemon-secret" not found
Jul 28 22:07:11.087941 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:11.087890    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" podUID="ac72fe00-deb7-48d6-9f44-1ff5bb582af0"
Jul 28 22:07:11.095069 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:11.095042    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"
Jul 28 22:07:11.107344 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:11.107319    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6p7fl" podUID="d3101ed0-7847-42ba-82ff-5786a9b34859"
Jul 28 22:07:11.247496 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:11.247463    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:07:11.710489 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:11.710454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:07:11.710690 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:11.710454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:07:11.710690 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:11.710454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:07:16.039361 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:16.039321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:16.039387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:16.039414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039481    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039504    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039556    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:18.039539441 +0000 UTC m=+285.351778410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039569    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls podName:d3101ed0-7847-42ba-82ff-5786a9b34859 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:18.039562978 +0000 UTC m=+285.351801946 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls") pod "dns-default-6p7fl" (UID: "d3101ed0-7847-42ba-82ff-5786a9b34859") : secret "dns-default-metrics-tls" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039629    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039648    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d5bd4976f-vsl8m: secret "image-registry-tls" not found
Jul 28 22:07:16.039929 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:07:16.039715    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls podName:c6a8aa9a-08fa-4177-bf04-f4e3cc27f955 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:18.039698664 +0000 UTC m=+285.351937656 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls") pod "image-registry-5d5bd4976f-vsl8m" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955") : secret "image-registry-tls" not found
Jul 28 22:07:22.238492 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:07:22.238440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:08:45.173547 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:08:45.173489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:08:45.174063 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:08:45.173666    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:08:45.174063 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:08:45.173731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs podName:6d0eaa6e-037f-449e-a177-9238bffa563e nodeName:}" failed. No retries permitted until 2026-07-28 22:10:47.173714236 +0000 UTC m=+374.485953222 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs") pod "network-metrics-daemon-b88t2" (UID: "6d0eaa6e-037f-449e-a177-9238bffa563e") : secret "metrics-daemon-secret" not found
Jul 28 22:09:01.300169 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.300085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"]
Jul 28 22:09:01.302984 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.302962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"
Jul 28 22:09:01.304130 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.304107    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"]
Jul 28 22:09:01.306412 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.306390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lck2s\""
Jul 28 22:09:01.306722 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.306706    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgrd"]
Jul 28 22:09:01.306834 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.306820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"
Jul 28 22:09:01.309874 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.309851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.310747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.310722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.311388 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.311342    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hwcjh\""
Jul 28 22:09:01.311680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.311661    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-584cc85f59-5zstr"]
Jul 28 22:09:01.311792 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.311778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.314370 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.314352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.315743 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.315720    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.315841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.315780    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 22:09:01.315841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.315731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 22:09:01.315947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.315782    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.315947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.315880    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8mq2b\""
Jul 28 22:09:01.320472 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.320451    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 22:09:01.320688 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.320486    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.320790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.320698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.320790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.320706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 22:09:01.321052 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.321035    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6r65m\""
Jul 28 22:09:01.321123 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.321096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 22:09:01.321179 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.321117    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 22:09:01.321840 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.321820    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"]
Jul 28 22:09:01.322049 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.322034    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 22:09:01.327528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.327509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"]
Jul 28 22:09:01.333253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.333229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgrd"]
Jul 28 22:09:01.338540 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.338520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-584cc85f59-5zstr"]
Jul 28 22:09:01.392501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.392677 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-stats-auth\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.392677 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-snapshots\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.392677 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-tmp\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.392872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47m69\" (UniqueName: \"kubernetes.io/projected/00847bff-28a3-4991-a974-983fe2e6aac1-kube-api-access-47m69\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.392872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.392872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.392872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzss\" (UniqueName: \"kubernetes.io/projected/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-kube-api-access-xhzss\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.392872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrzd\" (UniqueName: \"kubernetes.io/projected/174a3e55-aa08-41d1-bcec-8ce2383b8d85-kube-api-access-5xrzd\") pod \"network-check-source-7d88cb55d8-5rrkj\" (UID: \"174a3e55-aa08-41d1-bcec-8ce2383b8d85\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"
Jul 28 22:09:01.393062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-default-certificate\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.393062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjlt\" (UniqueName: \"kubernetes.io/projected/1d2ca956-c72a-4e5b-82d4-b164745eac61-kube-api-access-kxjlt\") pod \"volume-data-source-validator-549c6d54cf-6rtcq\" (UID: \"1d2ca956-c72a-4e5b-82d4-b164745eac61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"
Jul 28 22:09:01.393062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.392956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.393062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.393007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00847bff-28a3-4991-a974-983fe2e6aac1-serving-cert\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.395610 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.395570    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"]
Jul 28 22:09:01.398643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.398624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.401262 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.401240    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"]
Jul 28 22:09:01.401528 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.401498    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.401660 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.401630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vqfwl\""
Jul 28 22:09:01.401770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.401750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 22:09:01.402985 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.402964    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.403077 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.402975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 22:09:01.404238 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.404218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.407022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.407002    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 22:09:01.407177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.407159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 22:09:01.407418 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.407404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"]
Jul 28 22:09:01.407999 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.407981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5nrq7\""
Jul 28 22:09:01.409374 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.409356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.410487 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.410470    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6gfkm"]
Jul 28 22:09:01.410615 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.410597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.413431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.413413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 22:09:01.413531 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.413503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.414100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.414081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.414261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.414242    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.415207 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.415181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"]
Jul 28 22:09:01.416079 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.416000    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sd2p4\""
Jul 28 22:09:01.416962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.416912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hn68c\""
Jul 28 22:09:01.417796 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.417774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"]
Jul 28 22:09:01.417957 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.417942    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 22:09:01.418046 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.418024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.418335 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.418316    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 22:09:01.420033 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.419988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.421432 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.421412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.424458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.424441    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 22:09:01.432358 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.432216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"]
Jul 28 22:09:01.434294 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.434274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6gfkm"]
Jul 28 22:09:01.493847 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14ac364f-bac5-4c91-b6f0-01e23159abbc-serving-cert\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzss\" (UniqueName: \"kubernetes.io/projected/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-kube-api-access-xhzss\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f7da923-24db-4d5b-80e6-68ed4b46783c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-trusted-ca\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrzd\" (UniqueName: \"kubernetes.io/projected/174a3e55-aa08-41d1-bcec-8ce2383b8d85-kube-api-access-5xrzd\") pod \"network-check-source-7d88cb55d8-5rrkj\" (UID: \"174a3e55-aa08-41d1-bcec-8ce2383b8d85\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.493981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-default-certificate\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.494025 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.493998    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:01.993978958 +0000 UTC m=+269.306217959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjlt\" (UniqueName: \"kubernetes.io/projected/1d2ca956-c72a-4e5b-82d4-b164745eac61-kube-api-access-kxjlt\") pod \"volume-data-source-validator-549c6d54cf-6rtcq\" (UID: \"1d2ca956-c72a-4e5b-82d4-b164745eac61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00847bff-28a3-4991-a974-983fe2e6aac1-serving-cert\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4n58\" (UniqueName: \"kubernetes.io/projected/6f7da923-24db-4d5b-80e6-68ed4b46783c-kube-api-access-j4n58\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.494404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-stats-auth\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-snapshots\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.494513    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-tmp\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.494606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:01.994565286 +0000 UTC m=+269.306804268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : secret "router-metrics-certs-default" not found
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbx9\" (UniqueName: \"kubernetes.io/projected/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-kube-api-access-9sbx9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.494715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxjn\" (UniqueName: \"kubernetes.io/projected/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-kube-api-access-dvxjn\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcgt\" (UniqueName: \"kubernetes.io/projected/14ac364f-bac5-4c91-b6f0-01e23159abbc-kube-api-access-5pcgt\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-service-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47m69\" (UniqueName: \"kubernetes.io/projected/00847bff-28a3-4991-a974-983fe2e6aac1-kube-api-access-47m69\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-config\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.494982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-tmp\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.495071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.495006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.495472 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.495361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00847bff-28a3-4991-a974-983fe2e6aac1-snapshots\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.495825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.495804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00847bff-28a3-4991-a974-983fe2e6aac1-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.496546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.496523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-default-certificate\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.496653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.496636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00847bff-28a3-4991-a974-983fe2e6aac1-serving-cert\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.496822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.496807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-stats-auth\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.502546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.502486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzss\" (UniqueName: \"kubernetes.io/projected/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-kube-api-access-xhzss\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.503785 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.503764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrzd\" (UniqueName: \"kubernetes.io/projected/174a3e55-aa08-41d1-bcec-8ce2383b8d85-kube-api-access-5xrzd\") pod \"network-check-source-7d88cb55d8-5rrkj\" (UID: \"174a3e55-aa08-41d1-bcec-8ce2383b8d85\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"
Jul 28 22:09:01.504099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.504077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjlt\" (UniqueName: \"kubernetes.io/projected/1d2ca956-c72a-4e5b-82d4-b164745eac61-kube-api-access-kxjlt\") pod \"volume-data-source-validator-549c6d54cf-6rtcq\" (UID: \"1d2ca956-c72a-4e5b-82d4-b164745eac61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"
Jul 28 22:09:01.504347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.504332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47m69\" (UniqueName: \"kubernetes.io/projected/00847bff-28a3-4991-a974-983fe2e6aac1-kube-api-access-47m69\") pod \"insights-operator-5885fdb759-kxgrd\" (UID: \"00847bff-28a3-4991-a974-983fe2e6aac1\") " pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.591838 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.591756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:01.596077 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.596151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14ac364f-bac5-4c91-b6f0-01e23159abbc-serving-cert\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.596151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.596225 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f7da923-24db-4d5b-80e6-68ed4b46783c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.596225 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-trusted-ca\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.596225 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.596193    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 22:09:01.596351 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.596272    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls podName:6cc2d8ca-905d-470f-8f31-f687b63ee2a5 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:02.096250861 +0000 UTC m=+269.408489876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls") pod "cluster-samples-operator-6748489656-4smjc" (UID: "6cc2d8ca-905d-470f-8f31-f687b63ee2a5") : secret "samples-operator-tls" not found
Jul 28 22:09:01.596351 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4n58\" (UniqueName: \"kubernetes.io/projected/6f7da923-24db-4d5b-80e6-68ed4b46783c-kube-api-access-j4n58\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.596457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.596457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbx9\" (UniqueName: \"kubernetes.io/projected/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-kube-api-access-9sbx9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.596560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxjn\" (UniqueName: \"kubernetes.io/projected/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-kube-api-access-dvxjn\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.596560 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.596501    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:01.596560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcgt\" (UniqueName: \"kubernetes.io/projected/14ac364f-bac5-4c91-b6f0-01e23159abbc-kube-api-access-5pcgt\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.596560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.596772 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.596568    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:02.096550562 +0000 UTC m=+269.408789534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:01.596772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-config\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.596889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.596783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.597114 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.597082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f7da923-24db-4d5b-80e6-68ed4b46783c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.597273 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.597253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-config\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.597368 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.597351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14ac364f-bac5-4c91-b6f0-01e23159abbc-trusted-ca\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.598629 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.598605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/14ac364f-bac5-4c91-b6f0-01e23159abbc-serving-cert\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.598883 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.598867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.605440 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.605416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4n58\" (UniqueName: \"kubernetes.io/projected/6f7da923-24db-4d5b-80e6-68ed4b46783c-kube-api-access-j4n58\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:01.605751 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.605733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcgt\" (UniqueName: \"kubernetes.io/projected/14ac364f-bac5-4c91-b6f0-01e23159abbc-kube-api-access-5pcgt\") pod \"console-operator-584dcb6b54-6gfkm\" (UID: \"14ac364f-bac5-4c91-b6f0-01e23159abbc\") " pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.605811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.605765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxjn\" (UniqueName: \"kubernetes.io/projected/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-kube-api-access-dvxjn\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:01.605931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.605914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbx9\" (UniqueName: \"kubernetes.io/projected/c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40-kube-api-access-9sbx9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g\" (UID: \"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.615811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.615796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"
Jul 28 22:09:01.623919 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.623897    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"
Jul 28 22:09:01.630892 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.630869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-kxgrd"
Jul 28 22:09:01.683331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.683275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:01.715876 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.715850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"
Jul 28 22:09:01.735456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.735372    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:01.769997 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.769965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj"]
Jul 28 22:09:01.774791 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:01.774755    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174a3e55_aa08_41d1_bcec_8ce2383b8d85.slice/crio-50a4406171e26d9f6a8142cb1c36ef84437129d0cc8cf67b2ad0af1ddb6c3940 WatchSource:0}: Error finding container 50a4406171e26d9f6a8142cb1c36ef84437129d0cc8cf67b2ad0af1ddb6c3940: Status 404 returned error can't find the container with id 50a4406171e26d9f6a8142cb1c36ef84437129d0cc8cf67b2ad0af1ddb6c3940
Jul 28 22:09:01.908659 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.908636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6gfkm"]
Jul 28 22:09:01.911440 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:01.911416    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ac364f_bac5_4c91_b6f0_01e23159abbc.slice/crio-ca0adcf164fe1898d7fccc429e057eac644826069a33ac0a482b07bbbfa84e57 WatchSource:0}: Error finding container ca0adcf164fe1898d7fccc429e057eac644826069a33ac0a482b07bbbfa84e57: Status 404 returned error can't find the container with id ca0adcf164fe1898d7fccc429e057eac644826069a33ac0a482b07bbbfa84e57
Jul 28 22:09:01.922969 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.922951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g"]
Jul 28 22:09:01.924624 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:01.924602    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bd60aa_dc04_4bf5_97d2_b9a7693c4d40.slice/crio-a722b706616114e4dfc996b96ab479c30bdab667f8b56eeb41cc0474c37b6040 WatchSource:0}: Error finding container a722b706616114e4dfc996b96ab479c30bdab667f8b56eeb41cc0474c37b6040: Status 404 returned error can't find the container with id a722b706616114e4dfc996b96ab479c30bdab667f8b56eeb41cc0474c37b6040
Jul 28 22:09:01.967913 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.967877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj" event={"ID":"174a3e55-aa08-41d1-bcec-8ce2383b8d85","Type":"ContainerStarted","Data":"b6490f611b6b5e028376b9a42a6521e28b8139c8da8972bba5d831b3fa274691"}
Jul 28 22:09:01.968035 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.967941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj" event={"ID":"174a3e55-aa08-41d1-bcec-8ce2383b8d85","Type":"ContainerStarted","Data":"50a4406171e26d9f6a8142cb1c36ef84437129d0cc8cf67b2ad0af1ddb6c3940"}
Jul 28 22:09:01.969167 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.969138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g" event={"ID":"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40","Type":"ContainerStarted","Data":"a722b706616114e4dfc996b96ab479c30bdab667f8b56eeb41cc0474c37b6040"}
Jul 28 22:09:01.970397 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.970373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" event={"ID":"14ac364f-bac5-4c91-b6f0-01e23159abbc","Type":"ContainerStarted","Data":"ca0adcf164fe1898d7fccc429e057eac644826069a33ac0a482b07bbbfa84e57"}
Jul 28 22:09:01.993363 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.993312    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5rrkj" podStartSLOduration=0.993294148 podStartE2EDuration="993.294148ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:01.992635431 +0000 UTC m=+269.304874427" watchObservedRunningTime="2026-07-28 22:09:01.993294148 +0000 UTC m=+269.305533121"
Jul 28 22:09:01.995526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.995366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-kxgrd"]
Jul 28 22:09:01.996233 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.996209    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq"]
Jul 28 22:09:01.997054 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:01.997024    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2ca956_c72a_4e5b_82d4_b164745eac61.slice/crio-df1fef13597cd214ce83bd15ea7a2e2f109ca09feb2de63cd5f9e004cbe42c11 WatchSource:0}: Error finding container df1fef13597cd214ce83bd15ea7a2e2f109ca09feb2de63cd5f9e004cbe42c11: Status 404 returned error can't find the container with id df1fef13597cd214ce83bd15ea7a2e2f109ca09feb2de63cd5f9e004cbe42c11
Jul 28 22:09:01.997983 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:01.997965    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00847bff_28a3_4991_a974_983fe2e6aac1.slice/crio-55c848e82c8880a3af8119070e17667ad5c9a0a23c839d2962488655ccefc4fd WatchSource:0}: Error finding container 55c848e82c8880a3af8119070e17667ad5c9a0a23c839d2962488655ccefc4fd: Status 404 returned error can't find the container with id 55c848e82c8880a3af8119070e17667ad5c9a0a23c839d2962488655ccefc4fd
Jul 28 22:09:01.999035 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.999011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.999206 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.999186    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:02.999167509 +0000 UTC m=+270.311406497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:01.999306 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:01.999235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:01.999420 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.999388    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 22:09:01.999473 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:01.999450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:02.999434994 +0000 UTC m=+270.311673962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : secret "router-metrics-certs-default" not found
Jul 28 22:09:02.100511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:02.100445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:02.100670 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:02.100519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:02.100670 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:02.100605    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 22:09:02.100670 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:02.100635    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:02.100786 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:02.100675    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls podName:6cc2d8ca-905d-470f-8f31-f687b63ee2a5 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:03.100655532 +0000 UTC m=+270.412894523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls") pod "cluster-samples-operator-6748489656-4smjc" (UID: "6cc2d8ca-905d-470f-8f31-f687b63ee2a5") : secret "samples-operator-tls" not found
Jul 28 22:09:02.100786 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:02.100689    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:03.100683213 +0000 UTC m=+270.412922185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:02.975734 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:02.975690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgrd" event={"ID":"00847bff-28a3-4991-a974-983fe2e6aac1","Type":"ContainerStarted","Data":"55c848e82c8880a3af8119070e17667ad5c9a0a23c839d2962488655ccefc4fd"}
Jul 28 22:09:02.977312 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:02.977229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq" event={"ID":"1d2ca956-c72a-4e5b-82d4-b164745eac61","Type":"ContainerStarted","Data":"df1fef13597cd214ce83bd15ea7a2e2f109ca09feb2de63cd5f9e004cbe42c11"}
Jul 28 22:09:03.008170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:03.007942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:03.008170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:03.008070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:03.008170 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.008158    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 22:09:03.008444 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.008224    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:05.008206658 +0000 UTC m=+272.320445643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : secret "router-metrics-certs-default" not found
Jul 28 22:09:03.008444 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.008242    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:05.008233198 +0000 UTC m=+272.320472167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:03.109271 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:03.109231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:03.109462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:03.109348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:03.109462 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.109414    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 22:09:03.109462 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.109447    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:03.109662 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.109485    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls podName:6cc2d8ca-905d-470f-8f31-f687b63ee2a5 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:05.109466765 +0000 UTC m=+272.421705753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls") pod "cluster-samples-operator-6748489656-4smjc" (UID: "6cc2d8ca-905d-470f-8f31-f687b63ee2a5") : secret "samples-operator-tls" not found
Jul 28 22:09:03.109662 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:03.109502    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:05.109493441 +0000 UTC m=+272.421732410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:03.981879 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:03.981834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq" event={"ID":"1d2ca956-c72a-4e5b-82d4-b164745eac61","Type":"ContainerStarted","Data":"81abe32ca414e584a53da55a3204dcdf48822f8a25251b0f426695f7cf1efc5f"}
Jul 28 22:09:04.015819 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:04.015764    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-6rtcq" podStartSLOduration=1.5976892089999999 podStartE2EDuration="3.015748324s" totalImagesPullingTime="1.418059115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:04.015117557 +0000 UTC m=+271.327356549" watchObservedRunningTime="2026-07-28 22:09:04.015748324 +0000 UTC m=+271.327987315"
Jul 28 22:09:04.172540 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:04.172502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:04.269967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:04.269845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:05.024696 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.024653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:05.025184 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.024765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:05.025184 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.024853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:09.024827647 +0000 UTC m=+276.337066620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:05.025184 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.024896    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 22:09:05.025184 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.024953    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:09.024936201 +0000 UTC m=+276.337175185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : secret "router-metrics-certs-default" not found
Jul 28 22:09:05.125737 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.125711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:05.125859 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.125834    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:05.125903 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.125887    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:09.125873495 +0000 UTC m=+276.438112464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:05.125962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.125916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:05.126009 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.125972    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 22:09:05.126009 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:05.125993    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls podName:6cc2d8ca-905d-470f-8f31-f687b63ee2a5 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:09.125986902 +0000 UTC m=+276.438225895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls") pod "cluster-samples-operator-6748489656-4smjc" (UID: "6cc2d8ca-905d-470f-8f31-f687b63ee2a5") : secret "samples-operator-tls" not found
Jul 28 22:09:05.725109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.725065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:05.778361 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.778323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:05.989403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.989307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgrd" event={"ID":"00847bff-28a3-4991-a974-983fe2e6aac1","Type":"ContainerStarted","Data":"feeb67cc1996e3edb9025d4a783aea32c1873a2a7a1104a2b20f9fd9a3816697"}
Jul 28 22:09:05.990993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.990968    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/0.log"
Jul 28 22:09:05.991129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.991008    2563 generic.go:356] "Generic (PLEG): container finished" podID="14ac364f-bac5-4c91-b6f0-01e23159abbc" containerID="5f1edbd2be7a374d7cc10b2f92a437e26cb67ee8ea20e2cc430edb4bcf23f035" exitCode=255
Jul 28 22:09:05.991129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.991040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" event={"ID":"14ac364f-bac5-4c91-b6f0-01e23159abbc","Type":"ContainerDied","Data":"5f1edbd2be7a374d7cc10b2f92a437e26cb67ee8ea20e2cc430edb4bcf23f035"}
Jul 28 22:09:05.991298 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.991278    2563 scope.go:117] "RemoveContainer" containerID="5f1edbd2be7a374d7cc10b2f92a437e26cb67ee8ea20e2cc430edb4bcf23f035"
Jul 28 22:09:05.992644 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:05.992620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g" event={"ID":"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40","Type":"ContainerStarted","Data":"4ed471ac8fb1c4b5ad73cb8d282cc9f995b5af7f146ea4005d355cf5e5617fc4"}
Jul 28 22:09:06.005543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.005499    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-kxgrd" podStartSLOduration=1.869973377 podStartE2EDuration="5.005481246s" totalImagesPullingTime="3.135507869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:06.004486136 +0000 UTC m=+273.316725127" watchObservedRunningTime="2026-07-28 22:09:06.005481246 +0000 UTC m=+273.317720238"
Jul 28 22:09:06.020538 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.020492    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g" podStartSLOduration=1.808332768 podStartE2EDuration="5.020475647s" totalImagesPullingTime="3.212142879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:06.019423524 +0000 UTC m=+273.331662515" watchObservedRunningTime="2026-07-28 22:09:06.020475647 +0000 UTC m=+273.332714639"
Jul 28 22:09:06.177379 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.177342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:06.278147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.278055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:06.470966 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.470907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:06.569781 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.569693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:06.918753 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.918682    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d6vw6"]
Jul 28 22:09:06.922092 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.922069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:06.924778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.924760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 22:09:06.924778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.924768    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 22:09:06.929483 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.925257    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t4cf9\""
Jul 28 22:09:06.933768 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.933747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d6vw6"]
Jul 28 22:09:06.946164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.946134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:06.997155 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.997125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:09:06.997661 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.997643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/0.log"
Jul 28 22:09:06.997759 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.997681    2563 generic.go:356] "Generic (PLEG): container finished" podID="14ac364f-bac5-4c91-b6f0-01e23159abbc" containerID="eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7" exitCode=255
Jul 28 22:09:06.997798 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.997784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" event={"ID":"14ac364f-bac5-4c91-b6f0-01e23159abbc","Type":"ContainerDied","Data":"eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7"}
Jul 28 22:09:06.997842 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.997831    2563 scope.go:117] "RemoveContainer" containerID="5f1edbd2be7a374d7cc10b2f92a437e26cb67ee8ea20e2cc430edb4bcf23f035"
Jul 28 22:09:06.998087 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:06.998063    2563 scope.go:117] "RemoveContainer" containerID="eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7"
Jul 28 22:09:06.998285 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:06.998256    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6gfkm_openshift-console-operator(14ac364f-bac5-4c91-b6f0-01e23159abbc)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" podUID="14ac364f-bac5-4c91-b6f0-01e23159abbc"
Jul 28 22:09:07.026861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.026828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:07.043462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.043434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9eea590-a4d6-442b-b5a5-1b08df20248e-data-volume\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.043593 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.043472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9eea590-a4d6-442b-b5a5-1b08df20248e-crio-socket\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.043593 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.043539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvvsp\" (UniqueName: \"kubernetes.io/projected/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-api-access-pvvsp\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.043593 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.043570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.043769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.043736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144249 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9eea590-a4d6-442b-b5a5-1b08df20248e-crio-socket\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144405 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c9eea590-a4d6-442b-b5a5-1b08df20248e-crio-socket\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvvsp\" (UniqueName: \"kubernetes.io/projected/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-api-access-pvvsp\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144664 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144815 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144815 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.144787    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.144815 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.144806    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.144975 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.144824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9eea590-a4d6-442b-b5a5-1b08df20248e-data-volume\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.144975 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.144848    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:07.644825862 +0000 UTC m=+274.957064839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.144975 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.144909    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:07.644887577 +0000 UTC m=+274.957126548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.145164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.145142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9eea590-a4d6-442b-b5a5-1b08df20248e-data-volume\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.162008 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.161983    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvvsp\" (UniqueName: \"kubernetes.io/projected/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-api-access-pvvsp\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.178967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.178902    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"]
Jul 28 22:09:07.182772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.182742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:07.183209 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.183190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"
Jul 28 22:09:07.185988 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.185970    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:07.186104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.185973    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 22:09:07.186173 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.186155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kbd52\""
Jul 28 22:09:07.197517 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.197486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"]
Jul 28 22:09:07.264597 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.264540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:07.347424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.347393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkh2\" (UniqueName: \"kubernetes.io/projected/b0557595-9f56-4170-b49f-6787b40f702d-kube-api-access-mdkh2\") pod \"migrator-6865c9967-mk5g4\" (UID: \"b0557595-9f56-4170-b49f-6787b40f702d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"
Jul 28 22:09:07.448558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.448521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkh2\" (UniqueName: \"kubernetes.io/projected/b0557595-9f56-4170-b49f-6787b40f702d-kube-api-access-mdkh2\") pod \"migrator-6865c9967-mk5g4\" (UID: \"b0557595-9f56-4170-b49f-6787b40f702d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"
Jul 28 22:09:07.457165 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.457135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkh2\" (UniqueName: \"kubernetes.io/projected/b0557595-9f56-4170-b49f-6787b40f702d-kube-api-access-mdkh2\") pod \"migrator-6865c9967-mk5g4\" (UID: \"b0557595-9f56-4170-b49f-6787b40f702d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"
Jul 28 22:09:07.492725 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.492698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"
Jul 28 22:09:07.617129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.617085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4"]
Jul 28 22:09:07.619534 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:07.619509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0557595_9f56_4170_b49f_6787b40f702d.slice/crio-be209291931e835a965ff3c712be505f279c58af3ea59cc4a4d5612267aa9ea3 WatchSource:0}: Error finding container be209291931e835a965ff3c712be505f279c58af3ea59cc4a4d5612267aa9ea3: Status 404 returned error can't find the container with id be209291931e835a965ff3c712be505f279c58af3ea59cc4a4d5612267aa9ea3
Jul 28 22:09:07.650191 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.650164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.650269 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:07.650213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:07.650303 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.650280    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.650343 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.650312    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.650377 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.650323    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:08.650306711 +0000 UTC m=+275.962545679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.650485 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:07.650470    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:08.650450046 +0000 UTC m=+275.962689019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.002117 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.002083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4" event={"ID":"b0557595-9f56-4170-b49f-6787b40f702d","Type":"ContainerStarted","Data":"be209291931e835a965ff3c712be505f279c58af3ea59cc4a4d5612267aa9ea3"}
Jul 28 22:09:08.003362 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.003342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:09:08.003702 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.003683    2563 scope.go:117] "RemoveContainer" containerID="eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7"
Jul 28 22:09:08.003857 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:08.003839    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6gfkm_openshift-console-operator(14ac364f-bac5-4c91-b6f0-01e23159abbc)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" podUID="14ac364f-bac5-4c91-b6f0-01e23159abbc"
Jul 28 22:09:08.097699 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.097664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:08.197651 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.197611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:08.660314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.660279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:08.660471 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.660347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:08.660471 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:08.660445    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:08.660471 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:08.660454    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.660631 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:08.660502    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:10.660484319 +0000 UTC m=+277.972723290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:08.660631 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:08.660520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:10.660510923 +0000 UTC m=+277.972749898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.900853 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.900830    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kvwrj_a87dbd61-29cd-42e8-8ef8-3cfd9858beea/dns-node-resolver/0.log"
Jul 28 22:09:08.995242 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:08.995218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:09.008157 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.008134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4" event={"ID":"b0557595-9f56-4170-b49f-6787b40f702d","Type":"ContainerStarted","Data":"d82fc36a95ace2b8992ca9166f9455cf50db99fb8d92aea74d80e6bb7c268dff"}
Jul 28 22:09:09.008277 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.008184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4" event={"ID":"b0557595-9f56-4170-b49f-6787b40f702d","Type":"ContainerStarted","Data":"469ec5c1264654edea46df15c8ed28581ae87a8ad33fcbf320551e4e2d96e781"}
Jul 28 22:09:09.031280 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.031232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mk5g4" podStartSLOduration=0.768865847 podStartE2EDuration="2.031215949s" totalImagesPullingTime="1.262350102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:09.03014997 +0000 UTC m=+276.342388971" watchObservedRunningTime="2026-07-28 22:09:09.031215949 +0000 UTC m=+276.343454939"
Jul 28 22:09:09.065093 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.065057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:09.065242 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.065226    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:17.065209971 +0000 UTC m=+284.377448943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:09.065320 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.065269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:09.065437 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.065421    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 22:09:09.065496 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.065476    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:17.065460078 +0000 UTC m=+284.377699048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : secret "router-metrics-certs-default" not found
Jul 28 22:09:09.165817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.165733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:09.165983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.165834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:09.165983 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.165885    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:09.165983 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.165941    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 22:09:09.165983 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.165950    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:17.165936165 +0000 UTC m=+284.478175133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:09.165983 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:09.165982    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls podName:6cc2d8ca-905d-470f-8f31-f687b63ee2a5 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:17.165971472 +0000 UTC m=+284.478210455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls") pod "cluster-samples-operator-6748489656-4smjc" (UID: "6cc2d8ca-905d-470f-8f31-f687b63ee2a5") : secret "samples-operator-tls" not found
Jul 28 22:09:09.700434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:09.700404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gn6w4_034e0649-6338-4b99-a163-c35353acaa65/node-ca/0.log"
Jul 28 22:09:10.500795 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:10.500769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfl92_b1409118-44cf-4a04-b3a5-e1ef605d4e14/serve-healthcheck-canary/0.log"
Jul 28 22:09:10.677070 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:10.677014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:10.677284 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:10.677092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:10.677284 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:10.677177    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:10.677284 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:10.677237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:14.677224507 +0000 UTC m=+281.989463476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:10.677284 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:10.677175    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:10.677448 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:10.677345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:14.677324495 +0000 UTC m=+281.989563482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:11.671981 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.671898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:11.735747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.735712    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:11.735899 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.735766    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:11.736097 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.736084    2563 scope.go:117] "RemoveContainer" containerID="eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7"
Jul 28 22:09:11.736240 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:11.736223    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6gfkm_openshift-console-operator(14ac364f-bac5-4c91-b6f0-01e23159abbc)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" podUID="14ac364f-bac5-4c91-b6f0-01e23159abbc"
Jul 28 22:09:11.775753 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.775712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:11.873521 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:11.873482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:12.190413 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:12.190381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:12.403227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:12.403191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:12.479677 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:12.479574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:12.648378 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:12.648343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:12.783962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:12.783853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:13.772874 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:13.772835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:14.169735 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:14.169647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:14.441589 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:14.441524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:14.572855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:14.572826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:14.711767 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.711666    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" podUID="ac72fe00-deb7-48d6-9f44-1ff5bb582af0"
Jul 28 22:09:14.711767 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.711685    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6p7fl" podUID="d3101ed0-7847-42ba-82ff-5786a9b34859"
Jul 28 22:09:14.711767 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.711686    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"
Jul 28 22:09:14.714962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:14.714940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:14.715004 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:14.714993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:14.715081 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.715067    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:14.715081 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.715074    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:14.715155 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.715134    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:22.715116318 +0000 UTC m=+290.027355286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:14.715155 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:14.715152    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls podName:c9eea590-a4d6-442b-b5a5-1b08df20248e nodeName:}" failed. No retries permitted until 2026-07-28 22:09:22.715144982 +0000 UTC m=+290.027383951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6vw6" (UID: "c9eea590-a4d6-442b-b5a5-1b08df20248e") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:15.026740 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.026661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:15.026740 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.026678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:15.026967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.026664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:09:15.151620 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.151574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:15.427248 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.427152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:15.565889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.565844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:15.761766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:15.761721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:16.162526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:16.162438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:16.365259 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:16.365225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:16.565927 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:16.565895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:16.771393 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:16.771362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:17.133745 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.133709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:17.133935 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.133804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:17.133935 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:17.133922    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle podName:366197b2-1ac6-4901-8c66-20a5bf6f6e2b nodeName:}" failed. No retries permitted until 2026-07-28 22:09:33.133908551 +0000 UTC m=+300.446147523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle") pod "router-default-584cc85f59-5zstr" (UID: "366197b2-1ac6-4901-8c66-20a5bf6f6e2b") : configmap references non-existent config key: service-ca.crt
Jul 28 22:09:17.136243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.136223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-metrics-certs\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:17.234623 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.234573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:17.234774 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.234696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:17.234774 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:17.234717    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:17.234847 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:17.234778    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls podName:6f7da923-24db-4d5b-80e6-68ed4b46783c nodeName:}" failed. No retries permitted until 2026-07-28 22:09:33.23476271 +0000 UTC m=+300.547001679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xrdmd" (UID: "6f7da923-24db-4d5b-80e6-68ed4b46783c") : secret "cluster-monitoring-operator-tls" not found
Jul 28 22:09:17.237003 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.236977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cc2d8ca-905d-470f-8f31-f687b63ee2a5-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4smjc\" (UID: \"6cc2d8ca-905d-470f-8f31-f687b63ee2a5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:17.324182 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.324151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"
Jul 28 22:09:17.455463 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.455442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc"]
Jul 28 22:09:17.772771 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:17.772732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:18.037158 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.037080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc" event={"ID":"6cc2d8ca-905d-470f-8f31-f687b63ee2a5","Type":"ContainerStarted","Data":"857fb725db4170ee054dc3a420474f83c8b05cfa967c9a1ff4421a21c20c6f9e"}
Jul 28 22:09:18.042591 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.042562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:18.042680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.042666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:09:18.042724 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.042693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:18.042812 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:18.042794    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 22:09:18.042865 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:18.042856    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert podName:ac72fe00-deb7-48d6-9f44-1ff5bb582af0 nodeName:}" failed. No retries permitted until 2026-07-28 22:11:20.042840415 +0000 UTC m=+407.355079408 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-kgrsx" (UID: "ac72fe00-deb7-48d6-9f44-1ff5bb582af0") : secret "networking-console-plugin-cert" not found
Jul 28 22:09:18.044855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.044829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3101ed0-7847-42ba-82ff-5786a9b34859-metrics-tls\") pod \"dns-default-6p7fl\" (UID: \"d3101ed0-7847-42ba-82ff-5786a9b34859\") " pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:18.044990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.044973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"image-registry-5d5bd4976f-vsl8m\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") " pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:18.179128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.179078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:18.277702 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.277664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:18.331716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.331636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvh82\""
Jul 28 22:09:18.331716 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.331705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8lc2p\""
Jul 28 22:09:18.338304 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.338273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:18.338304 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.338292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:18.491097 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.491009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p7fl"]
Jul 28 22:09:18.495244 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:18.495217    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3101ed0_7847_42ba_82ff_5786a9b34859.slice/crio-6bebc5b88d1a075a59084207d75e2b94132ba1be57bff8c70bcb8e089c3bf040 WatchSource:0}: Error finding container 6bebc5b88d1a075a59084207d75e2b94132ba1be57bff8c70bcb8e089c3bf040: Status 404 returned error can't find the container with id 6bebc5b88d1a075a59084207d75e2b94132ba1be57bff8c70bcb8e089c3bf040
Jul 28 22:09:18.508626 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.508594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:18.521311 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.521289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:09:18.523763 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:18.523737    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a8aa9a_08fa_4177_bf04_f4e3cc27f955.slice/crio-99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06 WatchSource:0}: Error finding container 99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06: Status 404 returned error can't find the container with id 99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06
Jul 28 22:09:18.607680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.607646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:18.767230 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:18.767191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:19.044383 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.044342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p7fl" event={"ID":"d3101ed0-7847-42ba-82ff-5786a9b34859","Type":"ContainerStarted","Data":"6bebc5b88d1a075a59084207d75e2b94132ba1be57bff8c70bcb8e089c3bf040"}
Jul 28 22:09:19.046993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.046361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" event={"ID":"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955","Type":"ContainerStarted","Data":"ea361b2c4ef4d55eda61904c3f57bde7b630d1aaf78d9a3b58d9f0b29097f349"}
Jul 28 22:09:19.046993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.046406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" event={"ID":"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955","Type":"ContainerStarted","Data":"99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06"}
Jul 28 22:09:19.046993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.046900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:19.071612 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.071543    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" podStartSLOduration=263.071526885 podStartE2EDuration="4m23.071526885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:19.070049315 +0000 UTC m=+286.382288307" watchObservedRunningTime="2026-07-28 22:09:19.071526885 +0000 UTC m=+286.383765876"
Jul 28 22:09:19.347192 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.347094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:19.771132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.771095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:19.975908 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:19.975871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:20.052031 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.051980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc" event={"ID":"6cc2d8ca-905d-470f-8f31-f687b63ee2a5","Type":"ContainerStarted","Data":"dbef9b9a68b5fc0dd09f412d9a567b510a7ee284066a58edc91faed91cb3394a"}
Jul 28 22:09:20.052500 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.052054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc" event={"ID":"6cc2d8ca-905d-470f-8f31-f687b63ee2a5","Type":"ContainerStarted","Data":"b6aaa78365ea758ebabffb4a045d735819eaed2221c178682f45710ce374105d"}
Jul 28 22:09:20.071855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.071797    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4smjc" podStartSLOduration=17.107490132 podStartE2EDuration="19.071781025s" totalImagesPullingTime="1.964290893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:20.07073091 +0000 UTC m=+287.382969902" watchObservedRunningTime="2026-07-28 22:09:20.071781025 +0000 UTC m=+287.384020017"
Jul 28 22:09:20.274599 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.274433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:20.373524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.373494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:20.579372 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.579287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:20.773966 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:20.773930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:21.057330 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:21.057290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p7fl" event={"ID":"d3101ed0-7847-42ba-82ff-5786a9b34859","Type":"ContainerStarted","Data":"d753f04aaf463726b83a6099d50407a4fbae905ccfe06a4e424e9038469620d9"}
Jul 28 22:09:21.057731 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:21.057342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p7fl" event={"ID":"d3101ed0-7847-42ba-82ff-5786a9b34859","Type":"ContainerStarted","Data":"f6c33392d4f6dc14b9d034cba1d43468ae6dde14e034ab0909a6e2729d07ed66"}
Jul 28 22:09:21.075157 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:21.075107    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6p7fl" podStartSLOduration=251.407392669 podStartE2EDuration="4m13.075090047s" totalImagesPullingTime="1.667697378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:21.073769158 +0000 UTC m=+288.386008149" watchObservedRunningTime="2026-07-28 22:09:21.075090047 +0000 UTC m=+288.387329072"
Jul 28 22:09:21.567389 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:21.567358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:21.772211 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:21.772173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:22.060781 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.060749    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:22.164205 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.164173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:22.366012 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.365926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:22.783104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.783065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:22.783278 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.783201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:22.783741 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.783724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c9eea590-a4d6-442b-b5a5-1b08df20248e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:22.785395 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.785376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c9eea590-a4d6-442b-b5a5-1b08df20248e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6vw6\" (UID: \"c9eea590-a4d6-442b-b5a5-1b08df20248e\") " pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:22.835561 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.835530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d6vw6"
Jul 28 22:09:22.964886 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:22.964862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d6vw6"]
Jul 28 22:09:22.967112 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:22.967090    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9eea590_a4d6_442b_b5a5_1b08df20248e.slice/crio-2436bbeb55885662d3e591dd790144a0845d4d935dd026dc1fba16c8035d5c49 WatchSource:0}: Error finding container 2436bbeb55885662d3e591dd790144a0845d4d935dd026dc1fba16c8035d5c49: Status 404 returned error can't find the container with id 2436bbeb55885662d3e591dd790144a0845d4d935dd026dc1fba16c8035d5c49
Jul 28 22:09:23.065110 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:23.065024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6vw6" event={"ID":"c9eea590-a4d6-442b-b5a5-1b08df20248e","Type":"ContainerStarted","Data":"2436bbeb55885662d3e591dd790144a0845d4d935dd026dc1fba16c8035d5c49"}
Jul 28 22:09:25.239819 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:25.239777    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b88t2" podUID="6d0eaa6e-037f-449e-a177-9238bffa563e"
Jul 28 22:09:26.470759 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:26.470709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:26.528235 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:26.528197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:27.185557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:27.185517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:27.238787 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:27.238759    2563 scope.go:117] "RemoveContainer" containerID="eeafdd305d48306a1d4012dab515ff5943bb568596d16f98ea22200a7c2fc0b7"
Jul 28 22:09:27.304548 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:27.304515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:28.086362 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:28.086342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:09:28.086765 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:28.086474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" event={"ID":"14ac364f-bac5-4c91-b6f0-01e23159abbc","Type":"ContainerStarted","Data":"f0c5851ed9e496235071d54b19e0fff3ea792b0c1e8b3ff3729e67ef1b00c271"}
Jul 28 22:09:28.086822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:28.086803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:28.105516 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:28.105465    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm" podStartSLOduration=23.886102899 podStartE2EDuration="27.105448866s" totalImagesPullingTime="3.219345967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:28.104157106 +0000 UTC m=+295.416396097" watchObservedRunningTime="2026-07-28 22:09:28.105448866 +0000 UTC m=+295.417687856"
Jul 28 22:09:28.977595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:28.977535    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-6gfkm"
Jul 28 22:09:29.094285 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.094238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6vw6" event={"ID":"c9eea590-a4d6-442b-b5a5-1b08df20248e","Type":"ContainerStarted","Data":"2e2ff0cb2bf4ea50113eff55e8d72d326dbf1c37d5957e753e7788a624e79617"}
Jul 28 22:09:29.179817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.179767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:29.275007 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.274924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:29.325020 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.324938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:29.444821 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.444779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:29.636109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.636018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:29.727095 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:29.727059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:30.458593 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:30.458539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:30.518599 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:30.518552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:30.659162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:30.659126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:30.715316 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:30.715245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:31.036023 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:31.035937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:31.273258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:31.273222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:31.371649 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:31.371552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:32.067004 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:32.066974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6p7fl"
Jul 28 22:09:32.110189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:32.110143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6vw6" event={"ID":"c9eea590-a4d6-442b-b5a5-1b08df20248e","Type":"ContainerStarted","Data":"ef9cecf756f7192dd4308d06b917f5b81bf1f887ffad8fcc126d540369e621d3"}
Jul 28 22:09:32.868857 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:32.868820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:32.926441 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:32.926396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:33.115151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.115123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:09:33.115808 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.115786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:09:33.132523 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.132452    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 22:09:33.173402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.173370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:33.174172 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.174150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/366197b2-1ac6-4901-8c66-20a5bf6f6e2b-service-ca-bundle\") pod \"router-default-584cc85f59-5zstr\" (UID: \"366197b2-1ac6-4901-8c66-20a5bf6f6e2b\") " pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:33.274426 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.274277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:33.300926 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.276532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f7da923-24db-4d5b-80e6-68ed4b46783c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xrdmd\" (UID: \"6f7da923-24db-4d5b-80e6-68ed4b46783c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:33.439560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.439524    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6r65m\""
Jul 28 22:09:33.447011 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.446983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:33.511177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.511147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vqfwl\""
Jul 28 22:09:33.518460 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:33.518435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"
Jul 28 22:09:35.054024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.053993    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd"]
Jul 28 22:09:35.057159 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:35.057135    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7da923_24db_4d5b_80e6_68ed4b46783c.slice/crio-37cbd13e4664df02d6805849fe2ba0f490e9aab95947e02c1fb98f9197f7071b WatchSource:0}: Error finding container 37cbd13e4664df02d6805849fe2ba0f490e9aab95947e02c1fb98f9197f7071b: Status 404 returned error can't find the container with id 37cbd13e4664df02d6805849fe2ba0f490e9aab95947e02c1fb98f9197f7071b
Jul 28 22:09:35.059441 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.059353    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:09:35.076628 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.076606    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-584cc85f59-5zstr"]
Jul 28 22:09:35.078253 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:35.078229    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366197b2_1ac6_4901_8c66_20a5bf6f6e2b.slice/crio-bb42db726583922378ee4dc288ab48349336f4771199c7da57ad480670ab89bc WatchSource:0}: Error finding container bb42db726583922378ee4dc288ab48349336f4771199c7da57ad480670ab89bc: Status 404 returned error can't find the container with id bb42db726583922378ee4dc288ab48349336f4771199c7da57ad480670ab89bc
Jul 28 22:09:35.121647 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.121618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6vw6" event={"ID":"c9eea590-a4d6-442b-b5a5-1b08df20248e","Type":"ContainerStarted","Data":"09e939bd44aab4d90d747c3a65c200cfa7ff9f08ee719fbddf00b93b365d5620"}
Jul 28 22:09:35.122674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.122651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-584cc85f59-5zstr" event={"ID":"366197b2-1ac6-4901-8c66-20a5bf6f6e2b","Type":"ContainerStarted","Data":"bb42db726583922378ee4dc288ab48349336f4771199c7da57ad480670ab89bc"}
Jul 28 22:09:35.123690 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.123669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd" event={"ID":"6f7da923-24db-4d5b-80e6-68ed4b46783c","Type":"ContainerStarted","Data":"37cbd13e4664df02d6805849fe2ba0f490e9aab95947e02c1fb98f9197f7071b"}
Jul 28 22:09:35.147099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:35.147044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d6vw6" podStartSLOduration=17.253104682 podStartE2EDuration="29.147023997s" totalImagesPullingTime="11.893919315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:09:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:35.145593429 +0000 UTC m=+302.457832411" watchObservedRunningTime="2026-07-28 22:09:35.147023997 +0000 UTC m=+302.459262988"
Jul 28 22:09:36.128967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:36.128921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-584cc85f59-5zstr" event={"ID":"366197b2-1ac6-4901-8c66-20a5bf6f6e2b","Type":"ContainerStarted","Data":"4721ac832eb4408ec38324ccda32ba11a640aae6233032baacc2f72a59b98c79"}
Jul 28 22:09:36.151826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:36.151773    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-584cc85f59-5zstr" podStartSLOduration=35.151755761 podStartE2EDuration="35.151755761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:36.150742536 +0000 UTC m=+303.462981529" watchObservedRunningTime="2026-07-28 22:09:36.151755761 +0000 UTC m=+303.463994797"
Jul 28 22:09:36.448121 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:36.448087    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:36.450891 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:36.450866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:36.884465 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:36.884432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:37.134682 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:37.134592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd" event={"ID":"6f7da923-24db-4d5b-80e6-68ed4b46783c","Type":"ContainerStarted","Data":"9c92921b3c76d726ed1f44462c3559e247e6ebdda92d875c268b04cb2ce478b2"}
Jul 28 22:09:37.135122 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:37.135005    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:37.136112 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:37.136089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-584cc85f59-5zstr"
Jul 28 22:09:37.154680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:37.154634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xrdmd" podStartSLOduration=34.53097381 podStartE2EDuration="36.15461591s" totalImagesPullingTime="1.6236421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:37.153511826 +0000 UTC m=+304.465750833" watchObservedRunningTime="2026-07-28 22:09:37.15461591 +0000 UTC m=+304.466854903"
Jul 28 22:09:38.082566 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:38.082516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:38.343274 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:38.343189    2563 patch_prober.go:28] interesting pod/image-registry-5d5bd4976f-vsl8m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 22:09:38.343662 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:38.343261    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:09:39.091303 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:39.091268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:39.192661 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:39.192628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:39.271595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:39.271502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:39.330129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:39.330096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:39.511075 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:39.511039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:40.056998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:40.056972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:09:40.237132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:40.237077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:40.237897 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:40.237876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:09:40.318080 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:40.317993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:41.207363 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:41.207324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:41.477778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:41.477691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:41.534296 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:41.534258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:42.031671 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:42.031637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:42.856181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:42.856142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:42.912511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:42.912481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.264045 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.264013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.369745 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.369702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.464108 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.464066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.608601 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.608483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.633754 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.633707    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"]
Jul 28 22:09:43.638199 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.638180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.640858 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.640828    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 22:09:43.642048 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.642030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 22:09:43.642048 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.642035    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kts82\""
Jul 28 22:09:43.642217 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.642192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 22:09:43.644129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.644111    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"]
Jul 28 22:09:43.647462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.647444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.650262 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.650240    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 22:09:43.650477 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.650460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5rpnb\""
Jul 28 22:09:43.651099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.651077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 22:09:43.651187 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.651106    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 22:09:43.651776 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.651756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"]
Jul 28 22:09:43.656245 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.656226    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mbj4z"]
Jul 28 22:09:43.659452 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.659437    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.662440 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.662417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 22:09:43.662721 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.662504    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 22:09:43.662721 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.662569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 22:09:43.662910 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.662812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rhrfd\""
Jul 28 22:09:43.663457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.663432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"]
Jul 28 22:09:43.696849 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.696821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.758728 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.758685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.765731 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.765854 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.765854 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.765854 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77b9s\" (UniqueName: \"kubernetes.io/projected/62320737-29a9-4c8e-a474-604c406acd98-kube-api-access-77b9s\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.765953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlwn\" (UniqueName: \"kubernetes.io/projected/71cc8dc8-8594-4a28-945e-8474502e4a17-kube-api-access-phlwn\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.765953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-wtmp\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.765953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m94r\" (UniqueName: \"kubernetes.io/projected/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-api-access-4m94r\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.765953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71cc8dc8-8594-4a28-945e-8474502e4a17-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.765953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.766094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-metrics-client-ca\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.766094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.765980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-root\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.766094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.766094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-textfile\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.766223 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-sys\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.766223 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.766223 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.766223 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.766345 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.766345 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.766250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.861230 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.861133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:43.867200 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m94r\" (UniqueName: \"kubernetes.io/projected/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-api-access-4m94r\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.867319 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71cc8dc8-8594-4a28-945e-8474502e4a17-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.867354 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.867404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-metrics-client-ca\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867443 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-root\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867493 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.867542 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-root\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-textfile\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867637 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-sys\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867684 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.867800 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-sys\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867800 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:43.867789    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 22:09:43.867908 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-textfile\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.867908 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:09:43.867880    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls podName:62320737-29a9-4c8e-a474-604c406acd98 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:44.36785778 +0000 UTC m=+311.680096760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls") pod "node-exporter-mbj4z" (UID: "62320737-29a9-4c8e-a474-604c406acd98") : secret "node-exporter-tls" not found
Jul 28 22:09:43.868022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.868022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.867987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.868022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71cc8dc8-8594-4a28-945e-8474502e4a17-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-metrics-client-ca\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.868170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77b9s\" (UniqueName: \"kubernetes.io/projected/62320737-29a9-4c8e-a474-604c406acd98-kube-api-access-77b9s\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlwn\" (UniqueName: \"kubernetes.io/projected/71cc8dc8-8594-4a28-945e-8474502e4a17-kube-api-access-phlwn\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.868462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-wtmp\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868462 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-wtmp\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.868783 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.868996 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.868935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.869231 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.869208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.870396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.870371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.870783 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.870764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.870958 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.870935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.871022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.870995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.871075 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.871021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/71cc8dc8-8594-4a28-945e-8474502e4a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.875718 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.875698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m94r\" (UniqueName: \"kubernetes.io/projected/9c14d07d-0dc1-4a8a-b5ea-f46389f71db2-kube-api-access-4m94r\") pod \"kube-state-metrics-56d9f944b4-s79v8\" (UID: \"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.877227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.877205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlwn\" (UniqueName: \"kubernetes.io/projected/71cc8dc8-8594-4a28-945e-8474502e4a17-kube-api-access-phlwn\") pod \"openshift-state-metrics-b8f49f5c6-fbrnr\" (UID: \"71cc8dc8-8594-4a28-945e-8474502e4a17\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.877563 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.877544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77b9s\" (UniqueName: \"kubernetes.io/projected/62320737-29a9-4c8e-a474-604c406acd98-kube-api-access-77b9s\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:43.948211 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.948179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"
Jul 28 22:09:43.957002 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.956972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"
Jul 28 22:09:43.959817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:43.959611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:44.060168 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.060132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:44.094442 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.094416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr"]
Jul 28 22:09:44.096469 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:44.096442    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cc8dc8_8594_4a28_945e_8474502e4a17.slice/crio-9bb32d81c40faa63ef0a264db16b4e58b4440453e7c9acc9e5d98bda495aebbf WatchSource:0}: Error finding container 9bb32d81c40faa63ef0a264db16b4e58b4440453e7c9acc9e5d98bda495aebbf: Status 404 returned error can't find the container with id 9bb32d81c40faa63ef0a264db16b4e58b4440453e7c9acc9e5d98bda495aebbf
Jul 28 22:09:44.115461 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.115432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8"]
Jul 28 22:09:44.125622 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:44.125573    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c14d07d_0dc1_4a8a_b5ea_f46389f71db2.slice/crio-8542b0b4474a5a0f963785007744f92e5ff407d6ad8e872593957525b580ee9b WatchSource:0}: Error finding container 8542b0b4474a5a0f963785007744f92e5ff407d6ad8e872593957525b580ee9b: Status 404 returned error can't find the container with id 8542b0b4474a5a0f963785007744f92e5ff407d6ad8e872593957525b580ee9b
Jul 28 22:09:44.158379 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.158345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8" event={"ID":"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2","Type":"ContainerStarted","Data":"8542b0b4474a5a0f963785007744f92e5ff407d6ad8e872593957525b580ee9b"}
Jul 28 22:09:44.159398 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.159374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr" event={"ID":"71cc8dc8-8594-4a28-945e-8474502e4a17","Type":"ContainerStarted","Data":"9bb32d81c40faa63ef0a264db16b4e58b4440453e7c9acc9e5d98bda495aebbf"}
Jul 28 22:09:44.371828 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.371726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:44.374180 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.374156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62320737-29a9-4c8e-a474-604c406acd98-node-exporter-tls\") pod \"node-exporter-mbj4z\" (UID: \"62320737-29a9-4c8e-a474-604c406acd98\") " pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:44.388067 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.388035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:44.570165 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.570131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbj4z"
Jul 28 22:09:44.582801 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:44.582770    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62320737_29a9_4c8e_a474_604c406acd98.slice/crio-ae500b88a86af5ca184bcc0ba377d9a0144391f7f4eb6040c02f466f916616a1 WatchSource:0}: Error finding container ae500b88a86af5ca184bcc0ba377d9a0144391f7f4eb6040c02f466f916616a1: Status 404 returned error can't find the container with id ae500b88a86af5ca184bcc0ba377d9a0144391f7f4eb6040c02f466f916616a1
Jul 28 22:09:44.620530 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.620490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:44.707394 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:44.707291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:45.087515 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.087424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:45.166684 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.166631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbj4z" event={"ID":"62320737-29a9-4c8e-a474-604c406acd98","Type":"ContainerStarted","Data":"ae500b88a86af5ca184bcc0ba377d9a0144391f7f4eb6040c02f466f916616a1"}
Jul 28 22:09:45.169246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.169211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr" event={"ID":"71cc8dc8-8594-4a28-945e-8474502e4a17","Type":"ContainerStarted","Data":"d529ee0f50ebd879bb02da52e41933dad657c29ab8022b04f44d92a3b4ecae98"}
Jul 28 22:09:45.169424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.169275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr" event={"ID":"71cc8dc8-8594-4a28-945e-8474502e4a17","Type":"ContainerStarted","Data":"27522b4f935d074251e051fc36412602ba6ad190c41c7c4db201467cce91f407"}
Jul 28 22:09:45.211065 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.211030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:45.335379 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:45.335337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:46.175712 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.175671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr" event={"ID":"71cc8dc8-8594-4a28-945e-8474502e4a17","Type":"ContainerStarted","Data":"9b2404244d0122af1cd87c25b049d415c871693f52489b1f86543f9bb56ce567"}
Jul 28 22:09:46.177396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.177363    2563 generic.go:356] "Generic (PLEG): container finished" podID="62320737-29a9-4c8e-a474-604c406acd98" containerID="e0eac619a38e8b12963833fad36aa7ab2f74423e84812e5b5cce6b7afaee29b7" exitCode=0
Jul 28 22:09:46.177545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.177451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbj4z" event={"ID":"62320737-29a9-4c8e-a474-604c406acd98","Type":"ContainerDied","Data":"e0eac619a38e8b12963833fad36aa7ab2f74423e84812e5b5cce6b7afaee29b7"}
Jul 28 22:09:46.179845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.179814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8" event={"ID":"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2","Type":"ContainerStarted","Data":"fb8b652761fb09799b6c3d6f9221384bec2c746265d5abcd921734a78b6f1f03"}
Jul 28 22:09:46.179967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.179874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8" event={"ID":"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2","Type":"ContainerStarted","Data":"f7a4143f73833e4d7699dda886fd6aceb373db64c04bb3c8feb72ca172133cd2"}
Jul 28 22:09:46.179967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.179907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8" event={"ID":"9c14d07d-0dc1-4a8a-b5ea-f46389f71db2","Type":"ContainerStarted","Data":"b2d9431c8247d2d7682b110ad1ab15bb066837af90155a492a5f584bb257f588"}
Jul 28 22:09:46.205374 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.205333    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-fbrnr" podStartSLOduration=1.610675732 podStartE2EDuration="3.205317446s" totalImagesPullingTime="1.594641714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:46.204380978 +0000 UTC m=+313.516619996" watchObservedRunningTime="2026-07-28 22:09:46.205317446 +0000 UTC m=+313.517556453"
Jul 28 22:09:46.300823 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.300691    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s79v8" podStartSLOduration=1.598286476 podStartE2EDuration="3.300672429s" totalImagesPullingTime="1.702385953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:46.300366585 +0000 UTC m=+313.612605615" watchObservedRunningTime="2026-07-28 22:09:46.300672429 +0000 UTC m=+313.612911420"
Jul 28 22:09:46.639441 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.639403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"]
Jul 28 22:09:46.643143 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.643122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.646559 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.646534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 22:09:46.646678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.646592    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jmcj5\""
Jul 28 22:09:46.646678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.646574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a30q80ng5cdc5\""
Jul 28 22:09:46.646837 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.646823    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 22:09:46.646997 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.646982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 22:09:46.647051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.647016    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 22:09:46.647100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.647016    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 22:09:46.661128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.661106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"]
Jul 28 22:09:46.704845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.704816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:46.795943 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.795905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.795943 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.795945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.795968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-grpc-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.796018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.796040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.796056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4zbx\" (UniqueName: \"kubernetes.io/projected/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-kube-api-access-x4zbx\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.796101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-metrics-client-ca\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.796332 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.796134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.805922 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.805893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:46.896796 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.896705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.896796 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.896791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.896823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.896849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-grpc-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.897018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.897067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.897107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4zbx\" (UniqueName: \"kubernetes.io/projected/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-kube-api-access-x4zbx\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.897274 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.897174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-metrics-client-ca\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.898049 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.898024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-metrics-client-ca\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.899948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.899964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900271 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.900245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900397 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.900374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900469 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.900422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.900525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.900484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-secret-grpc-tls\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.908450 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.908428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4zbx\" (UniqueName: \"kubernetes.io/projected/8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46-kube-api-access-x4zbx\") pod \"thanos-querier-84cd445d4c-7jwrh\" (UID: \"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46\") " pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:46.932614 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.932590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:46.952969 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:46.952950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:47.100485 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.100453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"]
Jul 28 22:09:47.103546 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:47.103517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4f7906_6a1d_4e29_8d0f_bf347bdb3d46.slice/crio-60694a3d4576be3ef2db41c3b578ed20463933eebd4b800620b979160ab8d9ce WatchSource:0}: Error finding container 60694a3d4576be3ef2db41c3b578ed20463933eebd4b800620b979160ab8d9ce: Status 404 returned error can't find the container with id 60694a3d4576be3ef2db41c3b578ed20463933eebd4b800620b979160ab8d9ce
Jul 28 22:09:47.107669 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.107630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:47.186283 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.186247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbj4z" event={"ID":"62320737-29a9-4c8e-a474-604c406acd98","Type":"ContainerStarted","Data":"f5a4f1ab57d06ab369f258a9221221b0746c4963311e3fba0e6327e1eae92881"}
Jul 28 22:09:47.186764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.186314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbj4z" event={"ID":"62320737-29a9-4c8e-a474-604c406acd98","Type":"ContainerStarted","Data":"76bd07dcb28d03c69b6807aaa25a7597093572a47c3de55f63f045e44b1bc11b"}
Jul 28 22:09:47.187714 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.187674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"60694a3d4576be3ef2db41c3b578ed20463933eebd4b800620b979160ab8d9ce"}
Jul 28 22:09:47.213550 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:47.213497    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mbj4z" podStartSLOduration=2.875167097 podStartE2EDuration="4.213478534s" totalImagesPullingTime="1.247118108s" totalInitContainerRuntime="91.193329ms" isStatefulPod=true podCreationTimestamp="2026-07-28 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:47.212385694 +0000 UTC m=+314.524624685" watchObservedRunningTime="2026-07-28 22:09:47.213478534 +0000 UTC m=+314.525717524"
Jul 28 22:09:48.432502 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.432464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:48.454886 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.454853    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"]
Jul 28 22:09:48.458416 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.458391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.462322 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.462293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 22:09:48.463690 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.463611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-khkkk\""
Jul 28 22:09:48.471499 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.471474    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"]
Jul 28 22:09:48.528729 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.528695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:48.614099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.614062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltg7\" (UniqueName: \"kubernetes.io/projected/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-kube-api-access-hltg7\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.614294 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.614113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.629988 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.629951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:48.714877 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.714790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltg7\" (UniqueName: \"kubernetes.io/projected/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-kube-api-access-hltg7\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.714877 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.714856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.717454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.717424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.733102 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.733077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltg7\" (UniqueName: \"kubernetes.io/projected/bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2-kube-api-access-hltg7\") pod \"monitoring-plugin-68b7fc9574-rz6c8\" (UID: \"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:48.770332 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:48.770300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:49.422573 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:49.422547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"]
Jul 28 22:09:49.425082 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:09:49.425058    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb73e13a_9cc2_4a99_ba4e_ed0527cdd5a2.slice/crio-9db36cdc962dff4d848f948cc0cad585bb2330aeb5da89081289afb23553742b WatchSource:0}: Error finding container 9db36cdc962dff4d848f948cc0cad585bb2330aeb5da89081289afb23553742b: Status 404 returned error can't find the container with id 9db36cdc962dff4d848f948cc0cad585bb2330aeb5da89081289afb23553742b
Jul 28 22:09:49.982957 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:49.982925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:50.047231 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.047187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:09:50.204054 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.204012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"4b0024208148396efb2b3eb734d4786f287fd925bef3e9e0c837975a6e88bc45"}
Jul 28 22:09:50.204224 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.204151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"f62dc841009e71b2709816a2fc49f855e09a6aced8e2d387bf62e0e4df17e02b"}
Jul 28 22:09:50.204224 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.204188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"ca7c8996fc75bf3302221a87d014cb1817665b5dd8cb735c9fad4808c565142c"}
Jul 28 22:09:50.205373 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.205334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8" event={"ID":"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2","Type":"ContainerStarted","Data":"9db36cdc962dff4d848f948cc0cad585bb2330aeb5da89081289afb23553742b"}
Jul 28 22:09:50.256360 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.256271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:50.359793 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:50.359751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:51.211001 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.210963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8" event={"ID":"bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2","Type":"ContainerStarted","Data":"ee0e59bb0a5ab86dc094b91d4150c0ee3cfca0e592c78044dd42ef32eac50833"}
Jul 28 22:09:51.211441 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.211033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:51.214448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.214424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"c2c19dc48ec2fb2e65634efce264bef72aafc9d041942eefcea8137540c692a3"}
Jul 28 22:09:51.214595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.214482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"4d1e4901beca20bdcd67b7b695197289a422dd068b4bf80424ef97013dfa9082"}
Jul 28 22:09:51.214595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.214549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" event={"ID":"8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46","Type":"ContainerStarted","Data":"dff51550e82f2dfc3aeca13ffe56cb3e406790b2e321a59998fa98007b48b867"}
Jul 28 22:09:51.214595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.214595    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:09:51.216362 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.216342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8"
Jul 28 22:09:51.228109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.228066    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-rz6c8" podStartSLOduration=1.665543947 podStartE2EDuration="3.228051536s" totalImagesPullingTime="1.562507589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:51.22750809 +0000 UTC m=+318.539747083" watchObservedRunningTime="2026-07-28 22:09:51.228051536 +0000 UTC m=+318.540290526"
Jul 28 22:09:51.272707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.268517    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh" podStartSLOduration=1.602656286 podStartE2EDuration="5.268492106s" totalImagesPullingTime="3.66583582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:51.265254975 +0000 UTC m=+318.577494016" watchObservedRunningTime="2026-07-28 22:09:51.268492106 +0000 UTC m=+318.580731099"
Jul 28 22:09:51.936171 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.936133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:51.995270 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:51.995173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:56.491038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:56.491001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:56.587946 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:56.587905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:57.082177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:57.082137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:57.156378 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:57.156347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:09:57.224923 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:09:57.224897    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84cd445d4c-7jwrh"
Jul 28 22:10:06.350163 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:06.350130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:06.452770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:06.452720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:06.552221 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:06.552184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:07.241422 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:07.241383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:07.368638 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:07.368549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:10.177636 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:10.177601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:10.312295 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:10.312260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:11.473625 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:11.473574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:11.526095 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:11.526061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:15.069327 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.069276    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerName="registry" containerID="cri-o://ea361b2c4ef4d55eda61904c3f57bde7b630d1aaf78d9a3b58d9f0b29097f349" gracePeriod=30
Jul 28 22:10:15.309331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.309292    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerID="ea361b2c4ef4d55eda61904c3f57bde7b630d1aaf78d9a3b58d9f0b29097f349" exitCode=0
Jul 28 22:10:15.309454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.309342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" event={"ID":"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955","Type":"ContainerDied","Data":"ea361b2c4ef4d55eda61904c3f57bde7b630d1aaf78d9a3b58d9f0b29097f349"}
Jul 28 22:10:15.309454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.309378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m" event={"ID":"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955","Type":"ContainerDied","Data":"99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06"}
Jul 28 22:10:15.309454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.309392    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99450678ffc1191da258ae584d71f94022c932d3407dfaa0bf7c7f5452b2eb06"
Jul 28 22:10:15.319952 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.319888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:10:15.346545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346439    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346481    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dtkq\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.346954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346927    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.347059 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.346995    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted\") pod \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\" (UID: \"c6a8aa9a-08fa-4177-bf04-f4e3cc27f955\") "
Jul 28 22:10:15.347153 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.347127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:10:15.347489 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.347464    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-certificates\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.347627 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.347611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:10:15.349229 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.349179    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:10:15.349431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.349408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq" (OuterVolumeSpecName: "kube-api-access-7dtkq") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "kube-api-access-7dtkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:10:15.349834 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.349812    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:10:15.350027 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.350002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:10:15.350825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.350800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:10:15.357377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.357345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" (UID: "c6a8aa9a-08fa-4177-bf04-f4e3cc27f955"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:10:15.448464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448427    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-installation-pull-secrets\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448462    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-bound-sa-token\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448472    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-registry-tls\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448480    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-ca-trust-extracted\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448489    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-trusted-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448497    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dtkq\" (UniqueName: \"kubernetes.io/projected/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-kube-api-access-7dtkq\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:15.448653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:15.448505    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955-image-registry-private-configuration\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:10:16.313487 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:16.313454    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5bd4976f-vsl8m"
Jul 28 22:10:16.334510 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:16.334484    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:10:16.337627 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:16.337605    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d5bd4976f-vsl8m"]
Jul 28 22:10:17.247456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:17.247402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" path="/var/lib/kubelet/pods/c6a8aa9a-08fa-4177-bf04-f4e3cc27f955/volumes"
Jul 28 22:10:19.182153 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:19.182115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:19.229033 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:19.229006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:26.351873 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:26.351840    2563 generic.go:356] "Generic (PLEG): container finished" podID="c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40" containerID="4ed471ac8fb1c4b5ad73cb8d282cc9f995b5af7f146ea4005d355cf5e5617fc4" exitCode=0
Jul 28 22:10:26.352258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:26.351888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g" event={"ID":"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40","Type":"ContainerDied","Data":"4ed471ac8fb1c4b5ad73cb8d282cc9f995b5af7f146ea4005d355cf5e5617fc4"}
Jul 28 22:10:26.352258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:26.352153    2563 scope.go:117] "RemoveContainer" containerID="4ed471ac8fb1c4b5ad73cb8d282cc9f995b5af7f146ea4005d355cf5e5617fc4"
Jul 28 22:10:26.473513 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:26.473485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:26.577130 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:26.577095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:27.356693 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:27.356651    2563 generic.go:356] "Generic (PLEG): container finished" podID="00847bff-28a3-4991-a974-983fe2e6aac1" containerID="feeb67cc1996e3edb9025d4a783aea32c1873a2a7a1104a2b20f9fd9a3816697" exitCode=0
Jul 28 22:10:27.357109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:27.356725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgrd" event={"ID":"00847bff-28a3-4991-a974-983fe2e6aac1","Type":"ContainerDied","Data":"feeb67cc1996e3edb9025d4a783aea32c1873a2a7a1104a2b20f9fd9a3816697"}
Jul 28 22:10:27.357109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:27.357084    2563 scope.go:117] "RemoveContainer" containerID="feeb67cc1996e3edb9025d4a783aea32c1873a2a7a1104a2b20f9fd9a3816697"
Jul 28 22:10:27.358499 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:27.358479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g" event={"ID":"c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40","Type":"ContainerStarted","Data":"08ad0b9f9328a4787fa5b3e816097fb7284aa71e43ba3aa036fb7ad2f0cb8bfc"}
Jul 28 22:10:28.267419 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:28.267388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584cc85f59-5zstr_366197b2-1ac6-4901-8c66-20a5bf6f6e2b/router/0.log"
Jul 28 22:10:28.272924 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:28.272901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfl92_b1409118-44cf-4a04-b3a5-e1ef605d4e14/serve-healthcheck-canary/0.log"
Jul 28 22:10:28.363967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:28.363933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-kxgrd" event={"ID":"00847bff-28a3-4991-a974-983fe2e6aac1","Type":"ContainerStarted","Data":"1d8264cd4a06c53a074465f43c003f676e19abdb7594c87f47f8cfb3aed6c1c5"}
Jul 28 22:10:33.387004 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:33.386962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:33.481782 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:33.481748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:33.548540 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:33.548499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:47.238446 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:47.238410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:10:47.240821 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:47.240784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0eaa6e-037f-449e-a177-9238bffa563e-metrics-certs\") pod \"network-metrics-daemon-b88t2\" (UID: \"6d0eaa6e-037f-449e-a177-9238bffa563e\") " pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:10:47.441788 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:47.441756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5pt7\""
Jul 28 22:10:47.449343 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:47.449316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88t2"
Jul 28 22:10:47.578474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:47.578439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b88t2"]
Jul 28 22:10:47.581475 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:10:47.581445    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0eaa6e_037f_449e_a177_9238bffa563e.slice/crio-259cb9ce95196cba494088739682a6a1f65152e55bd20ff1b153143c1437316f WatchSource:0}: Error finding container 259cb9ce95196cba494088739682a6a1f65152e55bd20ff1b153143c1437316f: Status 404 returned error can't find the container with id 259cb9ce95196cba494088739682a6a1f65152e55bd20ff1b153143c1437316f
Jul 28 22:10:48.451314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:48.451283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88t2" event={"ID":"6d0eaa6e-037f-449e-a177-9238bffa563e","Type":"ContainerStarted","Data":"259cb9ce95196cba494088739682a6a1f65152e55bd20ff1b153143c1437316f"}
Jul 28 22:10:49.457537 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:49.457501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88t2" event={"ID":"6d0eaa6e-037f-449e-a177-9238bffa563e","Type":"ContainerStarted","Data":"729881c731e2d9a8fd775d169123f43e3bb5d4ad3e47ded85535f73a57c743de"}
Jul 28 22:10:49.458081 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:49.457555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88t2" event={"ID":"6d0eaa6e-037f-449e-a177-9238bffa563e","Type":"ContainerStarted","Data":"d562d99154b7f39133b902773cf489c160eb5e9c005c49079e4a9b9c1b7c053d"}
Jul 28 22:10:49.474893 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:49.474841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b88t2" podStartSLOduration=374.617807921 podStartE2EDuration="6m15.47482527s" totalImagesPullingTime="857.017349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:10:49.473320538 +0000 UTC m=+376.785559511" watchObservedRunningTime="2026-07-28 22:10:49.47482527 +0000 UTC m=+376.787064283"
Jul 28 22:10:49.557233 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:49.557197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:10:49.615505 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:10:49.614704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:02.959484 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:02.959443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:03.251471 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:03.251396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:08.029135 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.029092    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"]
Jul 28 22:11:08.029539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.029443    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerName="registry"
Jul 28 22:11:08.029539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.029455    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerName="registry"
Jul 28 22:11:08.029539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.029522    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a8aa9a-08fa-4177-bf04-f4e3cc27f955" containerName="registry"
Jul 28 22:11:08.034331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.034308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.036941 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.036921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h9t6r\""
Jul 28 22:11:08.037289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.037273    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 22:11:08.037704 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.037685    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 22:11:08.037809 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.037774    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 22:11:08.037809 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.037796    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 22:11:08.038087 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.038073    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 22:11:08.043756 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.043736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 22:11:08.049097 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.049074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"]
Jul 28 22:11:08.116138 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-metrics-client-ca\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-federate-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-serving-certs-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116406 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116406 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr46c\" (UniqueName: \"kubernetes.io/projected/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-kube-api-access-cr46c\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116406 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.116406 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.116398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217673 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217834 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217834 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-metrics-client-ca\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-federate-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.217953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.217903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-serving-certs-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.218150 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.218041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.218471 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.218443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr46c\" (UniqueName: \"kubernetes.io/projected/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-kube-api-access-cr46c\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.218576 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.218542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-metrics-client-ca\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.218667 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.218638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-serving-certs-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.218760 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.218733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.220366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.220330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.220480 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.220407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-federate-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.220480 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.220448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-telemeter-client-tls\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.220612 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.220527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-secret-telemeter-client\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.226280 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.226260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr46c\" (UniqueName: \"kubernetes.io/projected/e8bb8326-b9d4-44e8-9014-0c0ffa6638bb-kube-api-access-cr46c\") pod \"telemeter-client-6865b9c8bc-c2cfj\" (UID: \"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb\") " pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.343619 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.343515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"
Jul 28 22:11:08.478369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.478345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj"]
Jul 28 22:11:08.480303 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:11:08.480275    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bb8326_b9d4_44e8_9014_0c0ffa6638bb.slice/crio-0bfbf5c11f91df9581c6baf0011743d044c4682989ad877f62a93221be042cb9 WatchSource:0}: Error finding container 0bfbf5c11f91df9581c6baf0011743d044c4682989ad877f62a93221be042cb9: Status 404 returned error can't find the container with id 0bfbf5c11f91df9581c6baf0011743d044c4682989ad877f62a93221be042cb9
Jul 28 22:11:08.535210 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:08.535173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj" event={"ID":"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb","Type":"ContainerStarted","Data":"0bfbf5c11f91df9581c6baf0011743d044c4682989ad877f62a93221be042cb9"}
Jul 28 22:11:10.545068 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:10.544983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj" event={"ID":"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb","Type":"ContainerStarted","Data":"197bd0c7736e907d4322d19ddc1ac6918b19b10cc85e84591e23df56d6d7070f"}
Jul 28 22:11:12.556306 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:12.556265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj" event={"ID":"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb","Type":"ContainerStarted","Data":"5484f4b21f39ae35e4a98e25f650b9f29a0dfb6d54ae28a16da5954250064931"}
Jul 28 22:11:12.556694 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:12.556333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj" event={"ID":"e8bb8326-b9d4-44e8-9014-0c0ffa6638bb","Type":"ContainerStarted","Data":"95e5b8f0fd47b6f1c7424a377a85723779b76c4e2e4ca02c592bf28cd9f0a57c"}
Jul 28 22:11:12.580038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:12.579991    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6865b9c8bc-c2cfj" podStartSLOduration=1.366939595 podStartE2EDuration="4.579977057s" totalImagesPullingTime="3.213037462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:11:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:11:12.578509499 +0000 UTC m=+399.890748489" watchObservedRunningTime="2026-07-28 22:11:12.579977057 +0000 UTC m=+399.892216048"
Jul 28 22:11:13.653540 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:13.653502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:13.722762 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:13.722729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:15.866898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:15.866860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:15.926202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:15.926172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:18.027644 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:11:18.027606    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" podUID="ac72fe00-deb7-48d6-9f44-1ff5bb582af0"
Jul 28 22:11:18.162133 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:18.162097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:18.262574 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:18.262536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:18.443030 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:18.443003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:18.497646 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:18.497609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:18.583947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:18.583917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:11:20.129315 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.129254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:11:20.131757 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.131729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac72fe00-deb7-48d6-9f44-1ff5bb582af0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-kgrsx\" (UID: \"ac72fe00-deb7-48d6-9f44-1ff5bb582af0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:11:20.387927 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.387842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbvvm\""
Jul 28 22:11:20.395491 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.395463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"
Jul 28 22:11:20.550476 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:11:20.550440    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac72fe00_deb7_48d6_9f44_1ff5bb582af0.slice/crio-4480ccaab0557f4f0faed779c7aade30d220b98ee9914992ffce96b37ccf6df3 WatchSource:0}: Error finding container 4480ccaab0557f4f0faed779c7aade30d220b98ee9914992ffce96b37ccf6df3: Status 404 returned error can't find the container with id 4480ccaab0557f4f0faed779c7aade30d220b98ee9914992ffce96b37ccf6df3
Jul 28 22:11:20.550643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.550541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx"]
Jul 28 22:11:20.593307 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:20.593267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" event={"ID":"ac72fe00-deb7-48d6-9f44-1ff5bb582af0","Type":"ContainerStarted","Data":"4480ccaab0557f4f0faed779c7aade30d220b98ee9914992ffce96b37ccf6df3"}
Jul 28 22:11:21.598748 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:21.598714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" event={"ID":"ac72fe00-deb7-48d6-9f44-1ff5bb582af0","Type":"ContainerStarted","Data":"2927472b198e9d9430f6600ed39455bf91b2e2ee60efe31080faa584aa65b132"}
Jul 28 22:11:21.615917 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:21.615872    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-kgrsx" podStartSLOduration=388.653726905 podStartE2EDuration="6m29.615858748s" totalImagesPullingTime="962.131843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:11:21.614123091 +0000 UTC m=+408.926362094" watchObservedRunningTime="2026-07-28 22:11:21.615858748 +0000 UTC m=+408.928097778"
Jul 28 22:11:21.712529 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:21.712489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:21.770657 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:21.770547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:30.011848 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:30.011810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:30.064846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:30.064804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:35.651515 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:35.651475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:35.752373 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:35.752323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:35.851944 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:35.851911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:41.482460 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:41.482428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:41.585680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:41.585632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:58.388109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:58.388025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:11:58.481358 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:11:58.481316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:04.342339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:04.342301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:04.449777 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:04.449739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:05.141875 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.141831    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"]
Jul 28 22:12:05.145263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.145240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.148054 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.148032    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 22:12:05.148193 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.148156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fdhff\""
Jul 28 22:12:05.149300 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.149267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 22:12:05.153631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.153611    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"]
Jul 28 22:12:05.299732 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.299698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.299921 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.299746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmdxb\" (UniqueName: \"kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.299921 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.299851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.401307 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.401220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.401770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.401349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.401770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.401439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmdxb\" (UniqueName: \"kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.401770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.401667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.401906 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.401841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.410255 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.410233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmdxb\" (UniqueName: \"kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.455466 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.455435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:05.580822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.580789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"]
Jul 28 22:12:05.780632 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:05.780570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4" event={"ID":"706c0f11-996e-4e12-a9fb-e707d31e679b","Type":"ContainerStarted","Data":"dbaa47784fd3e759407ceee678a21ccfe9c88cb0ed754cea5380c01b1f1255c1"}
Jul 28 22:12:12.816152 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:12.816113    2563 generic.go:356] "Generic (PLEG): container finished" podID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerID="d3a860b8146716f1bc27943dc0351908066227c8d5fb023f5ef63b878c22178b" exitCode=0
Jul 28 22:12:12.816550 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:12.816190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4" event={"ID":"706c0f11-996e-4e12-a9fb-e707d31e679b","Type":"ContainerDied","Data":"d3a860b8146716f1bc27943dc0351908066227c8d5fb023f5ef63b878c22178b"}
Jul 28 22:12:15.830310 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:15.830275    2563 generic.go:356] "Generic (PLEG): container finished" podID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerID="39a2331333e79e56144668607d11ce0a772f206c31bcd0c918831a966cb84b96" exitCode=0
Jul 28 22:12:15.830737 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:15.830360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4" event={"ID":"706c0f11-996e-4e12-a9fb-e707d31e679b","Type":"ContainerDied","Data":"39a2331333e79e56144668607d11ce0a772f206c31bcd0c918831a966cb84b96"}
Jul 28 22:12:20.936860 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:20.936805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:21.037911 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:21.037876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:23.868571 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:23.868533    2563 generic.go:356] "Generic (PLEG): container finished" podID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerID="a1b09bae3ca1aecc027577869523d48d57ea1c150fa59c99fa2203e813e90e72" exitCode=0
Jul 28 22:12:23.868978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:23.868620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4" event={"ID":"706c0f11-996e-4e12-a9fb-e707d31e679b","Type":"ContainerDied","Data":"a1b09bae3ca1aecc027577869523d48d57ea1c150fa59c99fa2203e813e90e72"}
Jul 28 22:12:25.005560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.005530    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:25.173885 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.173793    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util\") pod \"706c0f11-996e-4e12-a9fb-e707d31e679b\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") "
Jul 28 22:12:25.173885 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.173844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle\") pod \"706c0f11-996e-4e12-a9fb-e707d31e679b\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") "
Jul 28 22:12:25.173885 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.173877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmdxb\" (UniqueName: \"kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb\") pod \"706c0f11-996e-4e12-a9fb-e707d31e679b\" (UID: \"706c0f11-996e-4e12-a9fb-e707d31e679b\") "
Jul 28 22:12:25.174487 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.174463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle" (OuterVolumeSpecName: "bundle") pod "706c0f11-996e-4e12-a9fb-e707d31e679b" (UID: "706c0f11-996e-4e12-a9fb-e707d31e679b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:12:25.176125 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.176092    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb" (OuterVolumeSpecName: "kube-api-access-wmdxb") pod "706c0f11-996e-4e12-a9fb-e707d31e679b" (UID: "706c0f11-996e-4e12-a9fb-e707d31e679b"). InnerVolumeSpecName "kube-api-access-wmdxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:12:25.177882 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.177862    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util" (OuterVolumeSpecName: "util") pod "706c0f11-996e-4e12-a9fb-e707d31e679b" (UID: "706c0f11-996e-4e12-a9fb-e707d31e679b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:12:25.274634 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.274573    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:25.274634 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.274634    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/706c0f11-996e-4e12-a9fb-e707d31e679b-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:25.274825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.274649    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmdxb\" (UniqueName: \"kubernetes.io/projected/706c0f11-996e-4e12-a9fb-e707d31e679b-kube-api-access-wmdxb\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:25.879254 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.879225    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4"
Jul 28 22:12:25.879417 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.879254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vjm4" event={"ID":"706c0f11-996e-4e12-a9fb-e707d31e679b","Type":"ContainerDied","Data":"dbaa47784fd3e759407ceee678a21ccfe9c88cb0ed754cea5380c01b1f1255c1"}
Jul 28 22:12:25.879417 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:25.879300    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbaa47784fd3e759407ceee678a21ccfe9c88cb0ed754cea5380c01b1f1255c1"
Jul 28 22:12:31.225230 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:31.225196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:32.038949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:32.038908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:33.292271 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292233    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"]
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292561    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="pull"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292573    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="pull"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292595    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="extract"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292600    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="extract"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292611    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="util"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292616    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="util"
Jul 28 22:12:33.292678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.292664    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="706c0f11-996e-4e12-a9fb-e707d31e679b" containerName="extract"
Jul 28 22:12:33.297098 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.297079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.299929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.299907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dpcd7\""
Jul 28 22:12:33.300384 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.300368    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 22:12:33.300719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.300696    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:12:33.327734 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.327713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"]
Jul 28 22:12:33.331262 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.331234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgh9\" (UniqueName: \"kubernetes.io/projected/849c7ae1-5cd8-44fd-922e-70d734d5d91d-kube-api-access-whgh9\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.331369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.331285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849c7ae1-5cd8-44fd-922e-70d734d5d91d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.432344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.432309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgh9\" (UniqueName: \"kubernetes.io/projected/849c7ae1-5cd8-44fd-922e-70d734d5d91d-kube-api-access-whgh9\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.432344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.432347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849c7ae1-5cd8-44fd-922e-70d734d5d91d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.432800 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.432781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849c7ae1-5cd8-44fd-922e-70d734d5d91d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.453186 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.453165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgh9\" (UniqueName: \"kubernetes.io/projected/849c7ae1-5cd8-44fd-922e-70d734d5d91d-kube-api-access-whgh9\") pod \"cert-manager-operator-controller-manager-55c444bf86-75nhn\" (UID: \"849c7ae1-5cd8-44fd-922e-70d734d5d91d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.606166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.606074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"
Jul 28 22:12:33.769609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.769558    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn"]
Jul 28 22:12:33.772189 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:12:33.772159    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849c7ae1_5cd8_44fd_922e_70d734d5d91d.slice/crio-708616135cbe6a6c72d2b6d3d9acf75b7c0e5b40b68c324055f11e44896e9619 WatchSource:0}: Error finding container 708616135cbe6a6c72d2b6d3d9acf75b7c0e5b40b68c324055f11e44896e9619: Status 404 returned error can't find the container with id 708616135cbe6a6c72d2b6d3d9acf75b7c0e5b40b68c324055f11e44896e9619
Jul 28 22:12:33.915331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:33.915240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn" event={"ID":"849c7ae1-5cd8-44fd-922e-70d734d5d91d","Type":"ContainerStarted","Data":"708616135cbe6a6c72d2b6d3d9acf75b7c0e5b40b68c324055f11e44896e9619"}
Jul 28 22:12:35.234108 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:35.234064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:35.334557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:35.334529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:35.927980 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:35.927942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn" event={"ID":"849c7ae1-5cd8-44fd-922e-70d734d5d91d","Type":"ContainerStarted","Data":"5452ba5894072ae3943d7d77da7d1330e507f14d0a5f0cae3c9dd443c14d5531"}
Jul 28 22:12:35.961575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:35.961514    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-75nhn" podStartSLOduration=1.424309734 podStartE2EDuration="2.961493189s" totalImagesPullingTime="1.537183455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:12:35.959655488 +0000 UTC m=+483.271894481" watchObservedRunningTime="2026-07-28 22:12:35.961493189 +0000 UTC m=+483.273732183"
Jul 28 22:12:36.407418 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.407377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:36.558358 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.558321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:36.793347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.793316    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"]
Jul 28 22:12:36.797001 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.796983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.801413 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.801392    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 22:12:36.802187 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.802169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 22:12:36.802310 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.802169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fdhff\""
Jul 28 22:12:36.827736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.827703    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"]
Jul 28 22:12:36.858403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.858365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwnxx\" (UniqueName: \"kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.858602 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.858419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.858602 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.858469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.959692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.959652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.959692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.959689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.959950 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.959750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwnxx\" (UniqueName: \"kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.960100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.960077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.960170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.960121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:36.969692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:36.969663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwnxx\" (UniqueName: \"kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:37.106403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.106325    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:37.132158 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.132128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:37.232871 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.232840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:37.260880 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.260852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"]
Jul 28 22:12:37.263470 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:12:37.263445    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4365c5bc_8059_4462_a833_cf2f26f9811e.slice/crio-7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544 WatchSource:0}: Error finding container 7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544: Status 404 returned error can't find the container with id 7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544
Jul 28 22:12:37.937873 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.937834    2563 generic.go:356] "Generic (PLEG): container finished" podID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerID="39ae0a89f178a636e3389e58a808e36fde9e9a63abbb2efcb7c0081f812fcf1f" exitCode=0
Jul 28 22:12:37.938267 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.937924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7" event={"ID":"4365c5bc-8059-4462-a833-cf2f26f9811e","Type":"ContainerDied","Data":"39ae0a89f178a636e3389e58a808e36fde9e9a63abbb2efcb7c0081f812fcf1f"}
Jul 28 22:12:37.938267 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:37.937974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7" event={"ID":"4365c5bc-8059-4462-a833-cf2f26f9811e","Type":"ContainerStarted","Data":"7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544"}
Jul 28 22:12:39.505350 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:39.505310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:39.728660 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:39.728622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:40.045842 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.045785    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"]
Jul 28 22:12:40.049067 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.049049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.051714 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.051695    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 22:12:40.051804 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.051784    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 22:12:40.052772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.052750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t8zd6\""
Jul 28 22:12:40.058813 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.058790    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"]
Jul 28 22:12:40.083089 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.083062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.083227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.083105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ght\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-kube-api-access-n5ght\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.184517 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.184481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.184681 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.184547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ght\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-kube-api-access-n5ght\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.192885 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.192860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.193132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.193111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ght\" (UniqueName: \"kubernetes.io/projected/751060b5-cb10-4a50-aaaa-be7e3032555f-kube-api-access-n5ght\") pod \"cert-manager-cainjector-559cdd8c87-xkrrx\" (UID: \"751060b5-cb10-4a50-aaaa-be7e3032555f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.387631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.387527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"
Jul 28 22:12:40.511796 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.511770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx"]
Jul 28 22:12:40.514501 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:12:40.514475    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod751060b5_cb10_4a50_aaaa_be7e3032555f.slice/crio-0df2ec48685176dd18b48ab950fb18308b716660639dad6b8311e4200edd76f8 WatchSource:0}: Error finding container 0df2ec48685176dd18b48ab950fb18308b716660639dad6b8311e4200edd76f8: Status 404 returned error can't find the container with id 0df2ec48685176dd18b48ab950fb18308b716660639dad6b8311e4200edd76f8
Jul 28 22:12:40.953719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.953679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx" event={"ID":"751060b5-cb10-4a50-aaaa-be7e3032555f","Type":"ContainerStarted","Data":"0df2ec48685176dd18b48ab950fb18308b716660639dad6b8311e4200edd76f8"}
Jul 28 22:12:40.955494 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.955468    2563 generic.go:356] "Generic (PLEG): container finished" podID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerID="285c204422bb14cc73a368ff065a472d9636e461fc2773e68ecc9b1bcff80fcd" exitCode=0
Jul 28 22:12:40.955628 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:40.955530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7" event={"ID":"4365c5bc-8059-4462-a833-cf2f26f9811e","Type":"ContainerDied","Data":"285c204422bb14cc73a368ff065a472d9636e461fc2773e68ecc9b1bcff80fcd"}
Jul 28 22:12:41.841954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:41.841899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:41.930216 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:41.930184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:41.963643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:41.963608    2563 generic.go:356] "Generic (PLEG): container finished" podID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerID="372d1749c38182933eb4e47253369a50617366e28cce4c0c46f32ab96b175fce" exitCode=0
Jul 28 22:12:41.963842 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:41.963694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7" event={"ID":"4365c5bc-8059-4462-a833-cf2f26f9811e","Type":"ContainerDied","Data":"372d1749c38182933eb4e47253369a50617366e28cce4c0c46f32ab96b175fce"}
Jul 28 22:12:42.524057 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:42.524018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:43.231423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.231359    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:43.312261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.312236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwnxx\" (UniqueName: \"kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx\") pod \"4365c5bc-8059-4462-a833-cf2f26f9811e\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") "
Jul 28 22:12:43.312439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.312274    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle\") pod \"4365c5bc-8059-4462-a833-cf2f26f9811e\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") "
Jul 28 22:12:43.312439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.312315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util\") pod \"4365c5bc-8059-4462-a833-cf2f26f9811e\" (UID: \"4365c5bc-8059-4462-a833-cf2f26f9811e\") "
Jul 28 22:12:43.312776 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.312749    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle" (OuterVolumeSpecName: "bundle") pod "4365c5bc-8059-4462-a833-cf2f26f9811e" (UID: "4365c5bc-8059-4462-a833-cf2f26f9811e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:12:43.315038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.315015    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx" (OuterVolumeSpecName: "kube-api-access-hwnxx") pod "4365c5bc-8059-4462-a833-cf2f26f9811e" (UID: "4365c5bc-8059-4462-a833-cf2f26f9811e"). InnerVolumeSpecName "kube-api-access-hwnxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:12:43.317134 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.317113    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util" (OuterVolumeSpecName: "util") pod "4365c5bc-8059-4462-a833-cf2f26f9811e" (UID: "4365c5bc-8059-4462-a833-cf2f26f9811e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:12:43.413736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.413704    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwnxx\" (UniqueName: \"kubernetes.io/projected/4365c5bc-8059-4462-a833-cf2f26f9811e-kube-api-access-hwnxx\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:43.413736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.413733    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:43.413736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.413744    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4365c5bc-8059-4462-a833-cf2f26f9811e-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:12:43.975499 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.975464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx" event={"ID":"751060b5-cb10-4a50-aaaa-be7e3032555f","Type":"ContainerStarted","Data":"5e2013429e24e3dd45af2802c4cb6faca62444386717790cc6be2caeccfee9d9"}
Jul 28 22:12:43.977469 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.977445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7"
Jul 28 22:12:43.977591 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.977448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5mq7" event={"ID":"4365c5bc-8059-4462-a833-cf2f26f9811e","Type":"ContainerDied","Data":"7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544"}
Jul 28 22:12:43.977591 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:43.977561    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d4a4adf8932af8f4b07c9bbe501cf32d4e93e086bdaf167c55daf8fd1168544"
Jul 28 22:12:44.294489 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:44.294389    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkrrx" podStartSLOduration=1.526546935 podStartE2EDuration="4.294368049s" totalImagesPullingTime="2.767821114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:12:44.015609324 +0000 UTC m=+491.327848315" watchObservedRunningTime="2026-07-28 22:12:44.294368049 +0000 UTC m=+491.606607040"
Jul 28 22:12:47.145974 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:47.145928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:48.981297 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981254    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vdxg5"]
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981618    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="pull"
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981631    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="pull"
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981644    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="extract"
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981649    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="extract"
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981658    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="util"
Jul 28 22:12:48.981708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981663    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="util"
Jul 28 22:12:48.981912 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.981725    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4365c5bc-8059-4462-a833-cf2f26f9811e" containerName="extract"
Jul 28 22:12:48.985731 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.985713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:48.988596 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.988560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v4fxs\""
Jul 28 22:12:48.993346 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:48.993316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vdxg5"]
Jul 28 22:12:49.059413 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.059374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.059576 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.059424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7g9\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-kube-api-access-gq7g9\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.160914 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.160860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.161107 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.160934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7g9\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-kube-api-access-gq7g9\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.169808 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.169768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.169947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.169854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7g9\" (UniqueName: \"kubernetes.io/projected/236f7d68-27e3-4127-bf13-410bf8c612cf-kube-api-access-gq7g9\") pod \"cert-manager-55b4d954d5-vdxg5\" (UID: \"236f7d68-27e3-4127-bf13-410bf8c612cf\") " pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.295741 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.295653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vdxg5"
Jul 28 22:12:49.425791 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.425765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vdxg5"]
Jul 28 22:12:49.427508 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:12:49.427482    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod236f7d68_27e3_4127_bf13_410bf8c612cf.slice/crio-c3c08b773966009ed315744abee0d4e90107db31418814b53fc892f4b5420c1c WatchSource:0}: Error finding container c3c08b773966009ed315744abee0d4e90107db31418814b53fc892f4b5420c1c: Status 404 returned error can't find the container with id c3c08b773966009ed315744abee0d4e90107db31418814b53fc892f4b5420c1c
Jul 28 22:12:49.838488 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.838452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:49.939396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:49.939361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:50.006642 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:50.006604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vdxg5" event={"ID":"236f7d68-27e3-4127-bf13-410bf8c612cf","Type":"ContainerStarted","Data":"1747614ed57571a9f04ba4bff1687605d7099e435c589c3ad22e618925fab270"}
Jul 28 22:12:50.006998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:50.006649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vdxg5" event={"ID":"236f7d68-27e3-4127-bf13-410bf8c612cf","Type":"ContainerStarted","Data":"c3c08b773966009ed315744abee0d4e90107db31418814b53fc892f4b5420c1c"}
Jul 28 22:12:50.023924 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:50.023860    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vdxg5" podStartSLOduration=2.023845938 podStartE2EDuration="2.023845938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:12:50.022859974 +0000 UTC m=+497.335098965" watchObservedRunningTime="2026-07-28 22:12:50.023845938 +0000 UTC m=+497.336084929"
Jul 28 22:12:56.107998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:56.107957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:56.439056 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:56.439017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:56.539808 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:56.539775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:58.115945 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.115908    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"]
Jul 28 22:12:58.119546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.119523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.122539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.122514    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fdhff\""
Jul 28 22:12:58.122539 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.122515    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 22:12:58.122733 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.122552    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 22:12:58.129161 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.129133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"]
Jul 28 22:12:58.240355 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.240319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chts7\" (UniqueName: \"kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.240545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.240377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.240545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.240397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.341409 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.341377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chts7\" (UniqueName: \"kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.341628 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.341450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.341628 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.341471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.341847 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.341823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.341892 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.341832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.349814 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.349789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chts7\" (UniqueName: \"kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.430759 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.430733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:12:58.488840 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.488797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:12:58.562969 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:58.562944    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"]
Jul 28 22:12:58.564958 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:12:58.564921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00031437_0328_4537_8291_4e93c46a46ab.slice/crio-361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7 WatchSource:0}: Error finding container 361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7: Status 404 returned error can't find the container with id 361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7
Jul 28 22:12:59.050870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:59.050834    2563 generic.go:356] "Generic (PLEG): container finished" podID="00031437-0328-4537-8291-4e93c46a46ab" containerID="85507348a2fbd647696da6cb5017afd996cc870cb34fcbb560ffa53439f2b880" exitCode=0
Jul 28 22:12:59.051052 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:59.050917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp" event={"ID":"00031437-0328-4537-8291-4e93c46a46ab","Type":"ContainerDied","Data":"85507348a2fbd647696da6cb5017afd996cc870cb34fcbb560ffa53439f2b880"}
Jul 28 22:12:59.051052 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:12:59.050970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp" event={"ID":"00031437-0328-4537-8291-4e93c46a46ab","Type":"ContainerStarted","Data":"361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7"}
Jul 28 22:13:00.057381 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:00.057348    2563 generic.go:356] "Generic (PLEG): container finished" podID="00031437-0328-4537-8291-4e93c46a46ab" containerID="872833e7016db8fab86490ff5dfb32da1783b7f0ca3a6eb7cf22bf7dbf917e01" exitCode=0
Jul 28 22:13:00.057799 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:00.057413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp" event={"ID":"00031437-0328-4537-8291-4e93c46a46ab","Type":"ContainerDied","Data":"872833e7016db8fab86490ff5dfb32da1783b7f0ca3a6eb7cf22bf7dbf917e01"}
Jul 28 22:13:00.935130 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:00.935098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:01.064993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:01.064956    2563 generic.go:356] "Generic (PLEG): container finished" podID="00031437-0328-4537-8291-4e93c46a46ab" containerID="9d3420a16c9cd7c2540da556086f6ec3fccda388096c638bb7c2f6bf547d9b8c" exitCode=0
Jul 28 22:13:01.065395 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:01.065018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp" event={"ID":"00031437-0328-4537-8291-4e93c46a46ab","Type":"ContainerDied","Data":"9d3420a16c9cd7c2540da556086f6ec3fccda388096c638bb7c2f6bf547d9b8c"}
Jul 28 22:13:02.199476 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.199447    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:13:02.277249 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.277210    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chts7\" (UniqueName: \"kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7\") pod \"00031437-0328-4537-8291-4e93c46a46ab\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") "
Jul 28 22:13:02.277249 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.277254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle\") pod \"00031437-0328-4537-8291-4e93c46a46ab\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") "
Jul 28 22:13:02.277497 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.277299    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util\") pod \"00031437-0328-4537-8291-4e93c46a46ab\" (UID: \"00031437-0328-4537-8291-4e93c46a46ab\") "
Jul 28 22:13:02.278010 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.277976    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle" (OuterVolumeSpecName: "bundle") pod "00031437-0328-4537-8291-4e93c46a46ab" (UID: "00031437-0328-4537-8291-4e93c46a46ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:13:02.279376 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.279346    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7" (OuterVolumeSpecName: "kube-api-access-chts7") pod "00031437-0328-4537-8291-4e93c46a46ab" (UID: "00031437-0328-4537-8291-4e93c46a46ab"). InnerVolumeSpecName "kube-api-access-chts7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:13:02.282927 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.282898    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util" (OuterVolumeSpecName: "util") pod "00031437-0328-4537-8291-4e93c46a46ab" (UID: "00031437-0328-4537-8291-4e93c46a46ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:13:02.378055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.377967    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chts7\" (UniqueName: \"kubernetes.io/projected/00031437-0328-4537-8291-4e93c46a46ab-kube-api-access-chts7\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:02.378055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.377997    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:02.378055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:02.378007    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00031437-0328-4537-8291-4e93c46a46ab-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:03.075993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:03.075961    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp"
Jul 28 22:13:03.075993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:03.075978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5nzxp" event={"ID":"00031437-0328-4537-8291-4e93c46a46ab","Type":"ContainerDied","Data":"361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7"}
Jul 28 22:13:03.076215 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:03.076022    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="361392f2a62917933ed96d88d30dd1175c465d3570c47778686146b77cd508f7"
Jul 28 22:13:12.153240 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:12.153199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:12.242179 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:12.242138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:12.742054 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:12.742007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:12.839744 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:12.839703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.067627 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.067513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.157996 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.157963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.220639 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.220601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"]
Jul 28 22:13:13.220993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.220977    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="pull"
Jul 28 22:13:13.220993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.220993    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="pull"
Jul 28 22:13:13.221109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.221012    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="util"
Jul 28 22:13:13.221109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.221018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="util"
Jul 28 22:13:13.221109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.221024    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="extract"
Jul 28 22:13:13.221109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.221030    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="extract"
Jul 28 22:13:13.221109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.221096    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00031437-0328-4537-8291-4e93c46a46ab" containerName="extract"
Jul 28 22:13:13.225474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.225454    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.228322 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.228303    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 22:13:13.228456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.228438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 22:13:13.228864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.228840    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 22:13:13.228864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.228856    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 22:13:13.229024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.228902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-67bxr\""
Jul 28 22:13:13.252262 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.252236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"]
Jul 28 22:13:13.369839 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.369743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwlmj\" (UniqueName: \"kubernetes.io/projected/30cc1e07-6a14-42af-8bff-f59dd44207e6-kube-api-access-qwlmj\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.369839 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.369815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.369839 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.369836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.370090 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.369910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.370090 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.369957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.470990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.470957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwlmj\" (UniqueName: \"kubernetes.io/projected/30cc1e07-6a14-42af-8bff-f59dd44207e6-kube-api-access-qwlmj\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.471162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.471012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.471162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.471031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.471162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.471050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.471162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.471067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.471513 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.471484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.473429 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.473397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30cc1e07-6a14-42af-8bff-f59dd44207e6-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.473557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.473533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.473677 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.473659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30cc1e07-6a14-42af-8bff-f59dd44207e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.490869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.490848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwlmj\" (UniqueName: \"kubernetes.io/projected/30cc1e07-6a14-42af-8bff-f59dd44207e6-kube-api-access-qwlmj\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-xtpjl\" (UID: \"30cc1e07-6a14-42af-8bff-f59dd44207e6\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.521035 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.521003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.536557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.536534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:13.620654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.620545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.679038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.679010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"]
Jul 28 22:13:13.680667 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:13:13.680641    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cc1e07_6a14_42af_8bff_f59dd44207e6.slice/crio-606039a5b982ab0c3f7f94191238e16ac924e152b062a764f3ced091bda8a703 WatchSource:0}: Error finding container 606039a5b982ab0c3f7f94191238e16ac924e152b062a764f3ced091bda8a703: Status 404 returned error can't find the container with id 606039a5b982ab0c3f7f94191238e16ac924e152b062a764f3ced091bda8a703
Jul 28 22:13:13.714017 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.713972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.802263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.802209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:13.903236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:13.903155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:14.130340 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:14.130310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl" event={"ID":"30cc1e07-6a14-42af-8bff-f59dd44207e6","Type":"ContainerStarted","Data":"606039a5b982ab0c3f7f94191238e16ac924e152b062a764f3ced091bda8a703"}
Jul 28 22:13:17.147942 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:17.147907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl" event={"ID":"30cc1e07-6a14-42af-8bff-f59dd44207e6","Type":"ContainerStarted","Data":"a72d02f6c1e2d90001f85a5b21c30e6e27f413e72d60d1372d67d4169cc7a87d"}
Jul 28 22:13:18.154615 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:18.154505    2563 generic.go:356] "Generic (PLEG): container finished" podID="30cc1e07-6a14-42af-8bff-f59dd44207e6" containerID="a72d02f6c1e2d90001f85a5b21c30e6e27f413e72d60d1372d67d4169cc7a87d" exitCode=0
Jul 28 22:13:18.154615 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:18.154563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl" event={"ID":"30cc1e07-6a14-42af-8bff-f59dd44207e6","Type":"ContainerDied","Data":"a72d02f6c1e2d90001f85a5b21c30e6e27f413e72d60d1372d67d4169cc7a87d"}
Jul 28 22:13:19.161122 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:19.161081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl" event={"ID":"30cc1e07-6a14-42af-8bff-f59dd44207e6","Type":"ContainerStarted","Data":"2bb795ddcb762c5a51bd0fdad71deaadce187e5fff197260cacaf573794a6877"}
Jul 28 22:13:19.161563 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:19.161325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:19.186915 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:19.186861    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl" podStartSLOduration=1.84221122 podStartE2EDuration="6.186844393s" totalImagesPullingTime="3.273296586s" totalInitContainerRuntime="1.071336587s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:19.183956214 +0000 UTC m=+526.496195224" watchObservedRunningTime="2026-07-28 22:13:19.186844393 +0000 UTC m=+526.499083385"
Jul 28 22:13:25.101025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:25.100985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:25.206139 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:25.206096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:26.934456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:26.934382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:27.044473 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:27.044436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:30.168983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:30.168944    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-xtpjl"
Jul 28 22:13:32.570850 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:32.570816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:32.699828 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:32.699795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:33.143047 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.143015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:33.408162 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.408088    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"]
Jul 28 22:13:33.415983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.415959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.421849 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.421826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 22:13:33.422691 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.422561    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qrtnr\""
Jul 28 22:13:33.423175 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.423058    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 22:13:33.435113 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.435083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"]
Jul 28 22:13:33.452213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.452181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee909b3-f3f8-45b8-8449-62b1f4817cab-tmp\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.452369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.452237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.452369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.452274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nfd\" (UniqueName: \"kubernetes.io/projected/cee909b3-f3f8-45b8-8449-62b1f4817cab-kube-api-access-b9nfd\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.544718 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.544678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgpvj"]
Jul 28 22:13:33.547926 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.547902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.550931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.550910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pnc85\""
Jul 28 22:13:33.551139 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.551126    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 22:13:33.553443 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.553418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee909b3-f3f8-45b8-8449-62b1f4817cab-tmp\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.553560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.553479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.553560 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.553511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nfd\" (UniqueName: \"kubernetes.io/projected/cee909b3-f3f8-45b8-8449-62b1f4817cab-kube-api-access-b9nfd\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.553700 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:13:33.553624    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 28 22:13:33.553756 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:13:33.553701    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs podName:cee909b3-f3f8-45b8-8449-62b1f4817cab nodeName:}" failed. No retries permitted until 2026-07-28 22:13:34.053682686 +0000 UTC m=+541.365921655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs") pod "kube-auth-proxy-9899fcb89-7c7qn" (UID: "cee909b3-f3f8-45b8-8449-62b1f4817cab") : secret "kube-auth-proxy-tls" not found
Jul 28 22:13:33.556044 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.556026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee909b3-f3f8-45b8-8449-62b1f4817cab-tmp\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.564973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.564948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgpvj"]
Jul 28 22:13:33.571626 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.571603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nfd\" (UniqueName: \"kubernetes.io/projected/cee909b3-f3f8-45b8-8449-62b1f4817cab-kube-api-access-b9nfd\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:33.614273 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.614233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:33.654698 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.654652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.654885 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.654819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jp7\" (UniqueName: \"kubernetes.io/projected/df50d724-eb3f-42e7-b34b-40e2d47893ab-kube-api-access-85jp7\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.693274 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.693239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:33.756000 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.755969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.756148 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.756058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jp7\" (UniqueName: \"kubernetes.io/projected/df50d724-eb3f-42e7-b34b-40e2d47893ab-kube-api-access-85jp7\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.756148 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:13:33.756106    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 22:13:33.756269 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:13:33.756169    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert podName:df50d724-eb3f-42e7-b34b-40e2d47893ab nodeName:}" failed. No retries permitted until 2026-07-28 22:13:34.25615387 +0000 UTC m=+541.568392839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert") pod "odh-model-controller-7998c67dc4-jgpvj" (UID: "df50d724-eb3f-42e7-b34b-40e2d47893ab") : secret "odh-model-controller-webhook-cert" not found
Jul 28 22:13:33.765100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.765077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jp7\" (UniqueName: \"kubernetes.io/projected/df50d724-eb3f-42e7-b34b-40e2d47893ab-kube-api-access-85jp7\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:33.798218 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.798193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:33.901491 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:33.901455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.005071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.004969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.058964 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.058927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:34.062779 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.062743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cee909b3-f3f8-45b8-8449-62b1f4817cab-tls-certs\") pod \"kube-auth-proxy-9899fcb89-7c7qn\" (UID: \"cee909b3-f3f8-45b8-8449-62b1f4817cab\") " pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:34.261102 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.261016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:34.263407 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.263378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df50d724-eb3f-42e7-b34b-40e2d47893ab-cert\") pod \"odh-model-controller-7998c67dc4-jgpvj\" (UID: \"df50d724-eb3f-42e7-b34b-40e2d47893ab\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:34.327483 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.327447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"
Jul 28 22:13:34.458271 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.458242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:34.466920 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.466890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.483236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.483215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn"]
Jul 28 22:13:34.485184 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:13:34.485161    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee909b3_f3f8_45b8_8449_62b1f4817cab.slice/crio-ba3f2d68a940437bd11fb3a1478dd35c0c3ee2227be9c8180bce268297fb395e WatchSource:0}: Error finding container ba3f2d68a940437bd11fb3a1478dd35c0c3ee2227be9c8180bce268297fb395e: Status 404 returned error can't find the container with id ba3f2d68a940437bd11fb3a1478dd35c0c3ee2227be9c8180bce268297fb395e
Jul 28 22:13:34.610104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.610049    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgpvj"]
Jul 28 22:13:34.612320 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:13:34.612296    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf50d724_eb3f_42e7_b34b_40e2d47893ab.slice/crio-f6f04dd55603fa25661869656b9e8884c5f65ab6d7a96aaa8e8bf7edf8722b25 WatchSource:0}: Error finding container f6f04dd55603fa25661869656b9e8884c5f65ab6d7a96aaa8e8bf7edf8722b25: Status 404 returned error can't find the container with id f6f04dd55603fa25661869656b9e8884c5f65ab6d7a96aaa8e8bf7edf8722b25
Jul 28 22:13:34.690037 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.690001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.788484 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.788384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.793511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.793482    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:34.797909 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.797886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.800551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.800524    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kg6rk\""
Jul 28 22:13:34.800752 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.800669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 22:13:34.800832 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.800754    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 22:13:34.800944 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.800928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 22:13:34.801010 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.800931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 22:13:34.810382 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.810350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:34.852801 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.852751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:34.865823 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.865978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.865978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.865978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.865978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkmm\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.865978 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.865970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.866159 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.866014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967488 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967877 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.967877 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.967740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkmm\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.968206 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.968168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.969827 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.969795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.970080 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.970057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.970154 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.970076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.970154 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.970085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.975682 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.975657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:34.975919 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:34.975902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkmm\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm\") pod \"istiod-openshift-gateway-7b7995d5cd-srfdd\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:35.108260 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:35.108162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:35.247431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:35.247336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj" event={"ID":"df50d724-eb3f-42e7-b34b-40e2d47893ab","Type":"ContainerStarted","Data":"f6f04dd55603fa25661869656b9e8884c5f65ab6d7a96aaa8e8bf7edf8722b25"}
Jul 28 22:13:35.247431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:35.247390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn" event={"ID":"cee909b3-f3f8-45b8-8449-62b1f4817cab","Type":"ContainerStarted","Data":"ba3f2d68a940437bd11fb3a1478dd35c0c3ee2227be9c8180bce268297fb395e"}
Jul 28 22:13:35.268525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:35.268494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:35.271867 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:13:35.271815    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3297c487_e530_41bf_be48_c6e687398b18.slice/crio-4f9af70e80689f55937f25c2cd9195aac663be425de167625b08d4410dedb74e WatchSource:0}: Error finding container 4f9af70e80689f55937f25c2cd9195aac663be425de167625b08d4410dedb74e: Status 404 returned error can't find the container with id 4f9af70e80689f55937f25c2cd9195aac663be425de167625b08d4410dedb74e
Jul 28 22:13:35.949916 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:35.949861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:36.255750 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:36.255634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" event={"ID":"3297c487-e530-41bf-be48-c6e687398b18","Type":"ContainerStarted","Data":"4f9af70e80689f55937f25c2cd9195aac663be425de167625b08d4410dedb74e"}
Jul 28 22:13:39.512402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:39.512360    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 22:13:39.512702 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:39.512449    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 22:13:40.279378 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.279342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" event={"ID":"3297c487-e530-41bf-be48-c6e687398b18","Type":"ContainerStarted","Data":"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"}
Jul 28 22:13:40.279624 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.279500    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:40.281064 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.281028    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-srfdd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:13:40.281201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.281079    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:13:40.281201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.281174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj" event={"ID":"df50d724-eb3f-42e7-b34b-40e2d47893ab","Type":"ContainerStarted","Data":"fd0df8872e0c8ed5c240cb26ffd5ce17a7e3a6ae092e07997adbd4609d2e9060"}
Jul 28 22:13:40.281329 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.281244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:40.282895 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.282867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn" event={"ID":"cee909b3-f3f8-45b8-8449-62b1f4817cab","Type":"ContainerStarted","Data":"b1d83c478938aa2947adfa3ae054001c1e344c5d518d4152c6ea5d9ac40d5703"}
Jul 28 22:13:40.311300 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.311247    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" podStartSLOduration=2.072910498 podStartE2EDuration="6.311225712s" totalImagesPullingTime="4.238315214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:40.307993588 +0000 UTC m=+547.620232583" watchObservedRunningTime="2026-07-28 22:13:40.311225712 +0000 UTC m=+547.623464705"
Jul 28 22:13:40.340075 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.339340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9899fcb89-7c7qn" podStartSLOduration=2.331943696 podStartE2EDuration="7.339316458s" totalImagesPullingTime="5.007372762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:40.336086027 +0000 UTC m=+547.648325016" watchObservedRunningTime="2026-07-28 22:13:40.339316458 +0000 UTC m=+547.651555448"
Jul 28 22:13:40.382358 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.382215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:40.476620 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:40.476564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:41.267159 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:41.267120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:41.288001 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:41.287972    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-srfdd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:13:41.288149 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:41.288020    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:13:41.389229 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:41.389195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:41.488784 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:41.488745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:43.231898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.231858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:43.385516 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.385476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:43.484780 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.484694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:43.598951 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.598912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:43.674095 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.674026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj" podStartSLOduration=5.776272455 podStartE2EDuration="10.674005946s" totalImagesPullingTime="4.897733491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:40.365614152 +0000 UTC m=+547.677853151" watchObservedRunningTime="2026-07-28 22:13:43.674005946 +0000 UTC m=+550.986244937"
Jul 28 22:13:43.675648 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.675627    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"]
Jul 28 22:13:43.679395 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.679379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.685263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685219    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 22:13:43.685263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 22:13:43.685263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:13:43.685507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qhskp\""
Jul 28 22:13:43.685507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685306    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 22:13:43.685694 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.685669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 22:13:43.709799 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.709771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"]
Jul 28 22:13:43.751339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.751228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4450d5de-5944-4ebd-b6ca-48c604d261c2-manager-config\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.751339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.751316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdnrt\" (UniqueName: \"kubernetes.io/projected/4450d5de-5944-4ebd-b6ca-48c604d261c2-kube-api-access-wdnrt\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.751574 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.751360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-metrics-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.751574 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.751385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.852356 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.852312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdnrt\" (UniqueName: \"kubernetes.io/projected/4450d5de-5944-4ebd-b6ca-48c604d261c2-kube-api-access-wdnrt\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.852569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.852374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-metrics-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.852569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.852406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.852569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.852493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4450d5de-5944-4ebd-b6ca-48c604d261c2-manager-config\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.853274 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.853249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4450d5de-5944-4ebd-b6ca-48c604d261c2-manager-config\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.855112 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.855086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-metrics-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.855614 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.855595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4450d5de-5944-4ebd-b6ca-48c604d261c2-cert\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.867473 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.867443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdnrt\" (UniqueName: \"kubernetes.io/projected/4450d5de-5944-4ebd-b6ca-48c604d261c2-kube-api-access-wdnrt\") pod \"lws-controller-manager-75cf9697f-zfljd\" (UID: \"4450d5de-5944-4ebd-b6ca-48c604d261c2\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:43.988706 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:43.988673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:44.141020 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.140983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"]
Jul 28 22:13:44.143976 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:13:44.143946    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4450d5de_5944_4ebd_b6ca_48c604d261c2.slice/crio-32e164d6097138d58923c5b06d978bc8e45213773570eb2f0c741ced95fe933d WatchSource:0}: Error finding container 32e164d6097138d58923c5b06d978bc8e45213773570eb2f0c741ced95fe933d: Status 404 returned error can't find the container with id 32e164d6097138d58923c5b06d978bc8e45213773570eb2f0c741ced95fe933d
Jul 28 22:13:44.288832 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.288800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:44.314244 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.314166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd" event={"ID":"4450d5de-5944-4ebd-b6ca-48c604d261c2","Type":"ContainerStarted","Data":"32e164d6097138d58923c5b06d978bc8e45213773570eb2f0c741ced95fe933d"}
Jul 28 22:13:44.605989 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.605886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:44.707056 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.707015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:44.830909 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.830876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:13:44.987240 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.987207    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:44.987404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:44.987383    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery" containerID="cri-o://57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730" gracePeriod=30
Jul 28 22:13:45.261216 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.261187    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:45.322409 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.322373    2563 generic.go:356] "Generic (PLEG): container finished" podID="3297c487-e530-41bf-be48-c6e687398b18" containerID="57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730" exitCode=0
Jul 28 22:13:45.322870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.322422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" event={"ID":"3297c487-e530-41bf-be48-c6e687398b18","Type":"ContainerDied","Data":"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"}
Jul 28 22:13:45.322870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.322451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"
Jul 28 22:13:45.322870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.322485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd" event={"ID":"3297c487-e530-41bf-be48-c6e687398b18","Type":"ContainerDied","Data":"4f9af70e80689f55937f25c2cd9195aac663be425de167625b08d4410dedb74e"}
Jul 28 22:13:45.322870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.322515    2563 scope.go:117] "RemoveContainer" containerID="57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"
Jul 28 22:13:45.333217 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.333194    2563 scope.go:117] "RemoveContainer" containerID="57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"
Jul 28 22:13:45.333526 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:13:45.333503    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730\": container with ID starting with 57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730 not found: ID does not exist" containerID="57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"
Jul 28 22:13:45.333654 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.333536    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730"} err="failed to get container status \"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730\": rpc error: code = NotFound desc = could not find container \"57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730\": container with ID starting with 57306b9e94f70e8f6374987eb7986921a61b9af1443686ecc2f3a40fe95e9730 not found: ID does not exist"
Jul 28 22:13:45.369841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.369807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.369990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.369874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.369990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.369945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.369990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.369969    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.370145 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.370064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.370202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.370144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.370202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.370185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvkmm\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm\") pod \"3297c487-e530-41bf-be48-c6e687398b18\" (UID: \"3297c487-e530-41bf-be48-c6e687398b18\") "
Jul 28 22:13:45.370711 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.370683    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:13:45.372973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.372860    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:13:45.372973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.372908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm" (OuterVolumeSpecName: "kube-api-access-bvkmm") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "kube-api-access-bvkmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:13:45.372973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.372943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token" (OuterVolumeSpecName: "istio-token") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:13:45.373182 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.373061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs" (OuterVolumeSpecName: "local-certs") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:13:45.373287 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.373260    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts" (OuterVolumeSpecName: "cacerts") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:13:45.373377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.373360    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3297c487-e530-41bf-be48-c6e687398b18" (UID: "3297c487-e530-41bf-be48-c6e687398b18"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:13:45.471401 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471369    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3297c487-e530-41bf-be48-c6e687398b18-local-certs\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471401 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471398    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-dns-cert\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471401 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471410    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-istio-token\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471676 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471418    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-istio-kubeconfig\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471676 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471427    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3297c487-e530-41bf-be48-c6e687398b18-istio-csr-ca-configmap\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471676 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471435    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3297c487-e530-41bf-be48-c6e687398b18-cacerts\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.471676 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.471444    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvkmm\" (UniqueName: \"kubernetes.io/projected/3297c487-e530-41bf-be48-c6e687398b18-kube-api-access-bvkmm\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:13:45.648928 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.648893    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:45.653869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:45.653842    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-srfdd"]
Jul 28 22:13:46.329555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:46.329520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd" event={"ID":"4450d5de-5944-4ebd-b6ca-48c604d261c2","Type":"ContainerStarted","Data":"3e244a7e1a0f6facc476849a89015380e2bbe0f58706f12e2b45d869f5441931"}
Jul 28 22:13:46.330013 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:46.329595    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:13:46.351926 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:46.351873    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd" podStartSLOduration=1.61136604 podStartE2EDuration="3.351858434s" totalImagesPullingTime="1.740492394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:46.349904313 +0000 UTC m=+553.662143336" watchObservedRunningTime="2026-07-28 22:13:46.351858434 +0000 UTC m=+553.664097424"
Jul 28 22:13:47.244461 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:47.244428    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3297c487-e530-41bf-be48-c6e687398b18" path="/var/lib/kubelet/pods/3297c487-e530-41bf-be48-c6e687398b18/volumes"
Jul 28 22:13:51.289289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:51.289250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jgpvj"
Jul 28 22:13:57.339036 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:13:57.338995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-zfljd"
Jul 28 22:14:14.294196 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:14.294148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:14.393991 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:14.393950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:32.489676 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:32.489632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:32.544025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:32.543989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:33.158061 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:33.158036    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:14:33.160156 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:33.160137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:14:34.022839 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:34.022797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:34.126961 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:34.126926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:34.225713 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:34.225671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:49.497326 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.497287    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"]
Jul 28 22:14:49.497875 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.497836    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery"
Jul 28 22:14:49.497875 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.497857    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery"
Jul 28 22:14:49.497995 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.497982    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3297c487-e530-41bf-be48-c6e687398b18" containerName="discovery"
Jul 28 22:14:49.501376 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.501354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.504077 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.504049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 22:14:49.504213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.504143    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 22:14:49.504276 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.504250    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cltnz\""
Jul 28 22:14:49.508272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.508245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"]
Jul 28 22:14:49.638966 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.638923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrlg\" (UniqueName: \"kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.639154 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.639035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.639154 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.639091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.740133 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.740089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.740312 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.740150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.740355 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.740330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrlg\" (UniqueName: \"kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.740538 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.740520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.740607 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.740541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.749200 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.749146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrlg\" (UniqueName: \"kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.811809 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.811772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:49.945735 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:49.945704    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"]
Jul 28 22:14:49.947685 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:14:49.947647    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5267aaea_2a77_442a_8aaa_3ee7ea1f1870.slice/crio-ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe WatchSource:0}: Error finding container ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe: Status 404 returned error can't find the container with id ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe
Jul 28 22:14:50.301313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.301222    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"]
Jul 28 22:14:50.304867 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.304849    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.312824 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.312798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"]
Jul 28 22:14:50.446764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.446718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crh9g\" (UniqueName: \"kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.446954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.446796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.446954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.446815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.547688 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.547647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crh9g\" (UniqueName: \"kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.548181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.547720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.548181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.547738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.548181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.548066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.548181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.548154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.556178 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.556120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crh9g\" (UniqueName: \"kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.615252 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.615219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:50.655409 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.655372    2563 generic.go:356] "Generic (PLEG): container finished" podID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerID="d9d320a0fe9f95b4f09ef61013ddaed2b2a434b476c3fda7aeee61a505b1102b" exitCode=0
Jul 28 22:14:50.655617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.655514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr" event={"ID":"5267aaea-2a77-442a-8aaa-3ee7ea1f1870","Type":"ContainerDied","Data":"d9d320a0fe9f95b4f09ef61013ddaed2b2a434b476c3fda7aeee61a505b1102b"}
Jul 28 22:14:50.655617 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.655560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr" event={"ID":"5267aaea-2a77-442a-8aaa-3ee7ea1f1870","Type":"ContainerStarted","Data":"ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe"}
Jul 28 22:14:50.656213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.656194    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:14:50.749643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.749610    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"]
Jul 28 22:14:50.751439 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:14:50.751410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf053b79a_34d7_4845_8d98_166ca5041d44.slice/crio-dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c WatchSource:0}: Error finding container dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c: Status 404 returned error can't find the container with id dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c
Jul 28 22:14:50.900764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.900725    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"]
Jul 28 22:14:50.904486 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.904467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:50.912203 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:50.912171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"]
Jul 28 22:14:51.051975 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.051944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.052147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.051993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.052232 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.052160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2cg\" (UniqueName: \"kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.152726 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.152649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2cg\" (UniqueName: \"kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.152726 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.152703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.152931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.152752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.153085 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.153066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.153125 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.153111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.160674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.160646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2cg\" (UniqueName: \"kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.236055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.236021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:51.305918 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.305888    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"]
Jul 28 22:14:51.311525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.311501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.316605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.316515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"]
Jul 28 22:14:51.388088 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.388061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"]
Jul 28 22:14:51.390196 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:14:51.390167    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a92178_f2e2_49c3_a702_3a941b83f222.slice/crio-60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74 WatchSource:0}: Error finding container 60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74: Status 404 returned error can't find the container with id 60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74
Jul 28 22:14:51.456413 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.456379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5srm\" (UniqueName: \"kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.456534 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.456423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.456534 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.456448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.558039 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.558003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5srm\" (UniqueName: \"kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.558039 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.558047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.558557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.558069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.558557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.558462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.558557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.558489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.567097 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.567071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5srm\" (UniqueName: \"kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.624120 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.624080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:51.663213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.663131    2563 generic.go:356] "Generic (PLEG): container finished" podID="f053b79a-34d7-4845-8d98-166ca5041d44" containerID="aa2783ab5473259d5b1a35171ae5a9313db0c01952287d8c4e45b36a90ec0ea4" exitCode=0
Jul 28 22:14:51.663377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.663218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerDied","Data":"aa2783ab5473259d5b1a35171ae5a9313db0c01952287d8c4e45b36a90ec0ea4"}
Jul 28 22:14:51.663377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.663272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerStarted","Data":"dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c"}
Jul 28 22:14:51.665021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.664999    2563 generic.go:356] "Generic (PLEG): container finished" podID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerID="8bf9e725ea1807e4ff25e73f3a132c271b80d80083be74cff26d98492ec4c8f5" exitCode=0
Jul 28 22:14:51.665147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.665065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g" event={"ID":"e0a92178-f2e2-49c3-a702-3a941b83f222","Type":"ContainerDied","Data":"8bf9e725ea1807e4ff25e73f3a132c271b80d80083be74cff26d98492ec4c8f5"}
Jul 28 22:14:51.665147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.665100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g" event={"ID":"e0a92178-f2e2-49c3-a702-3a941b83f222","Type":"ContainerStarted","Data":"60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74"}
Jul 28 22:14:51.768901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:51.768853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"]
Jul 28 22:14:51.793444 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:14:51.793409    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8bff7b_abd6_489c_8277_48ef22b22f7a.slice/crio-3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0 WatchSource:0}: Error finding container 3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0: Status 404 returned error can't find the container with id 3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0
Jul 28 22:14:52.672524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.672428    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerID="d584e2764f8824f2cdbde4021f64ead6617a50d7bb217a153cd5e10ea5381154" exitCode=0
Jul 28 22:14:52.673003 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.672515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb" event={"ID":"2e8bff7b-abd6-489c-8277-48ef22b22f7a","Type":"ContainerDied","Data":"d584e2764f8824f2cdbde4021f64ead6617a50d7bb217a153cd5e10ea5381154"}
Jul 28 22:14:52.673003 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.672595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb" event={"ID":"2e8bff7b-abd6-489c-8277-48ef22b22f7a","Type":"ContainerStarted","Data":"3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0"}
Jul 28 22:14:52.674459 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.674434    2563 generic.go:356] "Generic (PLEG): container finished" podID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerID="db8874bf2c2d4b73f378c5294c73ad48e6071b9e09f79defbabf75a8e775acbf" exitCode=0
Jul 28 22:14:52.674573 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.674462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr" event={"ID":"5267aaea-2a77-442a-8aaa-3ee7ea1f1870","Type":"ContainerDied","Data":"db8874bf2c2d4b73f378c5294c73ad48e6071b9e09f79defbabf75a8e775acbf"}
Jul 28 22:14:52.676655 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.676630    2563 generic.go:356] "Generic (PLEG): container finished" podID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerID="8ec98d67e7e75b1ba48d718a8165bdb613851b226d9d7a53ff2590bc56bc05c4" exitCode=0
Jul 28 22:14:52.676749 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:52.676666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g" event={"ID":"e0a92178-f2e2-49c3-a702-3a941b83f222","Type":"ContainerDied","Data":"8ec98d67e7e75b1ba48d718a8165bdb613851b226d9d7a53ff2590bc56bc05c4"}
Jul 28 22:14:53.683850 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.683813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerStarted","Data":"087d8257d7195eccabf43916829379cea79d8f6eae4ef2dd008d8ada6f00df5c"}
Jul 28 22:14:53.685778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.685746    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerID="8d6eef8c0a24a714d106470b162157dc90d60e557a0cada4c0847b4e6eccc856" exitCode=0
Jul 28 22:14:53.685910 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.685823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb" event={"ID":"2e8bff7b-abd6-489c-8277-48ef22b22f7a","Type":"ContainerDied","Data":"8d6eef8c0a24a714d106470b162157dc90d60e557a0cada4c0847b4e6eccc856"}
Jul 28 22:14:53.688281 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.688257    2563 generic.go:356] "Generic (PLEG): container finished" podID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerID="c5801ff621d4a8f19386d66801c1dcbb4c419e5c2dd4fe59e37d3154e3ad1e1a" exitCode=0
Jul 28 22:14:53.688391 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.688343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr" event={"ID":"5267aaea-2a77-442a-8aaa-3ee7ea1f1870","Type":"ContainerDied","Data":"c5801ff621d4a8f19386d66801c1dcbb4c419e5c2dd4fe59e37d3154e3ad1e1a"}
Jul 28 22:14:53.690526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.690503    2563 generic.go:356] "Generic (PLEG): container finished" podID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerID="1f37d9a5b1961677afa8644161ab302e8cf7dfdcdc498842e49bd5d63f0f97f8" exitCode=0
Jul 28 22:14:53.690653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:53.690567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g" event={"ID":"e0a92178-f2e2-49c3-a702-3a941b83f222","Type":"ContainerDied","Data":"1f37d9a5b1961677afa8644161ab302e8cf7dfdcdc498842e49bd5d63f0f97f8"}
Jul 28 22:14:54.703059 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.703018    2563 generic.go:356] "Generic (PLEG): container finished" podID="f053b79a-34d7-4845-8d98-166ca5041d44" containerID="087d8257d7195eccabf43916829379cea79d8f6eae4ef2dd008d8ada6f00df5c" exitCode=0
Jul 28 22:14:54.703530 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.703060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerDied","Data":"087d8257d7195eccabf43916829379cea79d8f6eae4ef2dd008d8ada6f00df5c"}
Jul 28 22:14:54.705503 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.705482    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerID="aed346061d278f143debce0b25b4be8c3b0f5bf5ffdd12777ebc869f33e39414" exitCode=0
Jul 28 22:14:54.705609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.705570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb" event={"ID":"2e8bff7b-abd6-489c-8277-48ef22b22f7a","Type":"ContainerDied","Data":"aed346061d278f143debce0b25b4be8c3b0f5bf5ffdd12777ebc869f33e39414"}
Jul 28 22:14:54.853228 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.853202    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:54.896850 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.896820    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:54.990356 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.990262    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle\") pod \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") "
Jul 28 22:14:54.990356 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.990351    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util\") pod \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") "
Jul 28 22:14:54.990568 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.990376    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrlg\" (UniqueName: \"kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg\") pod \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\" (UID: \"5267aaea-2a77-442a-8aaa-3ee7ea1f1870\") "
Jul 28 22:14:54.990773 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.990748    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle" (OuterVolumeSpecName: "bundle") pod "5267aaea-2a77-442a-8aaa-3ee7ea1f1870" (UID: "5267aaea-2a77-442a-8aaa-3ee7ea1f1870"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:54.992668 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.992643    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg" (OuterVolumeSpecName: "kube-api-access-wrrlg") pod "5267aaea-2a77-442a-8aaa-3ee7ea1f1870" (UID: "5267aaea-2a77-442a-8aaa-3ee7ea1f1870"). InnerVolumeSpecName "kube-api-access-wrrlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:14:54.996103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:54.996064    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util" (OuterVolumeSpecName: "util") pod "5267aaea-2a77-442a-8aaa-3ee7ea1f1870" (UID: "5267aaea-2a77-442a-8aaa-3ee7ea1f1870"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:55.091293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091251    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util\") pod \"e0a92178-f2e2-49c3-a702-3a941b83f222\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") "
Jul 28 22:14:55.091458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk2cg\" (UniqueName: \"kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg\") pod \"e0a92178-f2e2-49c3-a702-3a941b83f222\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") "
Jul 28 22:14:55.091458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle\") pod \"e0a92178-f2e2-49c3-a702-3a941b83f222\" (UID: \"e0a92178-f2e2-49c3-a702-3a941b83f222\") "
Jul 28 22:14:55.091631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091612    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.091669 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091636    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrlg\" (UniqueName: \"kubernetes.io/projected/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-kube-api-access-wrrlg\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.091669 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091651    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5267aaea-2a77-442a-8aaa-3ee7ea1f1870-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.091925 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.091891    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle" (OuterVolumeSpecName: "bundle") pod "e0a92178-f2e2-49c3-a702-3a941b83f222" (UID: "e0a92178-f2e2-49c3-a702-3a941b83f222"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:55.093473 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.093447    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg" (OuterVolumeSpecName: "kube-api-access-lk2cg") pod "e0a92178-f2e2-49c3-a702-3a941b83f222" (UID: "e0a92178-f2e2-49c3-a702-3a941b83f222"). InnerVolumeSpecName "kube-api-access-lk2cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:14:55.096652 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.096615    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util" (OuterVolumeSpecName: "util") pod "e0a92178-f2e2-49c3-a702-3a941b83f222" (UID: "e0a92178-f2e2-49c3-a702-3a941b83f222"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:55.192511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.192465    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk2cg\" (UniqueName: \"kubernetes.io/projected/e0a92178-f2e2-49c3-a702-3a941b83f222-kube-api-access-lk2cg\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.192511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.192502    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.192511 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.192511    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a92178-f2e2-49c3-a702-3a941b83f222-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.713228 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.713193    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr"
Jul 28 22:14:55.713729 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.713195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr" event={"ID":"5267aaea-2a77-442a-8aaa-3ee7ea1f1870","Type":"ContainerDied","Data":"ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe"}
Jul 28 22:14:55.713729 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.713324    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea371cedfa47b0130bd00e87534d8a592ee454a23d38f805a82722cec60e4efe"
Jul 28 22:14:55.715208 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.715183    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g"
Jul 28 22:14:55.715341 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.715254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g" event={"ID":"e0a92178-f2e2-49c3-a702-3a941b83f222","Type":"ContainerDied","Data":"60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74"}
Jul 28 22:14:55.715341 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.715296    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60299db747796d9cc6fe0bb4b313da763320671e55fa25559c624e48bbb89c74"
Jul 28 22:14:55.717788 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.717765    2563 generic.go:356] "Generic (PLEG): container finished" podID="f053b79a-34d7-4845-8d98-166ca5041d44" containerID="1099aad41f6d7c26ac7aa91ed3ded1582e7805ca7ff72a2d9bfec15e3403c59e" exitCode=0
Jul 28 22:14:55.717860 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.717802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerDied","Data":"1099aad41f6d7c26ac7aa91ed3ded1582e7805ca7ff72a2d9bfec15e3403c59e"}
Jul 28 22:14:55.852467 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.852440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:55.898481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.898447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util\") pod \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") "
Jul 28 22:14:55.898661 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.898515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5srm\" (UniqueName: \"kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm\") pod \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") "
Jul 28 22:14:55.900609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.900560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm" (OuterVolumeSpecName: "kube-api-access-s5srm") pod "2e8bff7b-abd6-489c-8277-48ef22b22f7a" (UID: "2e8bff7b-abd6-489c-8277-48ef22b22f7a"). InnerVolumeSpecName "kube-api-access-s5srm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:14:55.903435 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.903406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util" (OuterVolumeSpecName: "util") pod "2e8bff7b-abd6-489c-8277-48ef22b22f7a" (UID: "2e8bff7b-abd6-489c-8277-48ef22b22f7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:55.999258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.999179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle\") pod \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\" (UID: \"2e8bff7b-abd6-489c-8277-48ef22b22f7a\") "
Jul 28 22:14:55.999396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.999328    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5srm\" (UniqueName: \"kubernetes.io/projected/2e8bff7b-abd6-489c-8277-48ef22b22f7a-kube-api-access-s5srm\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.999396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.999338    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:55.999761 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:55.999738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle" (OuterVolumeSpecName: "bundle") pod "2e8bff7b-abd6-489c-8277-48ef22b22f7a" (UID: "2e8bff7b-abd6-489c-8277-48ef22b22f7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:56.100150 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.100116    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e8bff7b-abd6-489c-8277-48ef22b22f7a-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:56.724998 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.724968    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb"
Jul 28 22:14:56.725403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.725000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb" event={"ID":"2e8bff7b-abd6-489c-8277-48ef22b22f7a","Type":"ContainerDied","Data":"3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0"}
Jul 28 22:14:56.725403 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.725051    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b2f769b4a4ef942019bbdb863f5d3baaf6cdd8922869be65e2a3695186574a0"
Jul 28 22:14:56.873238 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.873213    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:56.905785 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.905751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crh9g\" (UniqueName: \"kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g\") pod \"f053b79a-34d7-4845-8d98-166ca5041d44\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") "
Jul 28 22:14:56.905971 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.905856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle\") pod \"f053b79a-34d7-4845-8d98-166ca5041d44\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") "
Jul 28 22:14:56.905971 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.905881    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util\") pod \"f053b79a-34d7-4845-8d98-166ca5041d44\" (UID: \"f053b79a-34d7-4845-8d98-166ca5041d44\") "
Jul 28 22:14:56.906509 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.906475    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle" (OuterVolumeSpecName: "bundle") pod "f053b79a-34d7-4845-8d98-166ca5041d44" (UID: "f053b79a-34d7-4845-8d98-166ca5041d44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:56.908040 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.908009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g" (OuterVolumeSpecName: "kube-api-access-crh9g") pod "f053b79a-34d7-4845-8d98-166ca5041d44" (UID: "f053b79a-34d7-4845-8d98-166ca5041d44"). InnerVolumeSpecName "kube-api-access-crh9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:14:56.910673 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:56.910640    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util" (OuterVolumeSpecName: "util") pod "f053b79a-34d7-4845-8d98-166ca5041d44" (UID: "f053b79a-34d7-4845-8d98-166ca5041d44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:14:57.007104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.007010    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-bundle\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:57.007104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.007043    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f053b79a-34d7-4845-8d98-166ca5041d44-util\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:57.007104 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.007053    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crh9g\" (UniqueName: \"kubernetes.io/projected/f053b79a-34d7-4845-8d98-166ca5041d44-kube-api-access-crh9g\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:14:57.669806 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.669704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:14:57.732545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.732511    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz"
Jul 28 22:14:57.732545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.732529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz" event={"ID":"f053b79a-34d7-4845-8d98-166ca5041d44","Type":"ContainerDied","Data":"dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c"}
Jul 28 22:14:57.732974 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:14:57.732596    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc326804257a00ea5a87823246650b403ef910038bb867b60973718f7bbc3d5c"
Jul 28 22:15:02.365318 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:02.365284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:02.463215 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:02.463172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:02.655395 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:02.655305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:03.259621 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:03.259565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:04.405364 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:04.405327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:07.498995 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:07.498956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:07.607286 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:07.607254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:10.894624 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:10.894572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:12.868186 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:12.868153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:13.120425 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:13.120322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:15.527802 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:15.527762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:16.671901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:16.671861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:16.725198 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:16.725158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:17.088764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.088726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:17.195533 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.195500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:17.304030 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.303996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"]
Jul 28 22:15:17.304515 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304498    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="extract"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304518    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="extract"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304542    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="util"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304550    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="util"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304562    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="util"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304570    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="util"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304593    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="util"
Jul 28 22:15:17.304604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304604    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="util"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304613    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304621    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304633    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304640    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304653    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304660    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304685    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304693    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304702    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304709    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304719    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="util"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304726    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="util"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304746    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="pull"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304762    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304848    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5267aaea-2a77-442a-8aaa-3ee7ea1f1870" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304861    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a92178-f2e2-49c3-a702-3a941b83f222" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304872    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f053b79a-34d7-4845-8d98-166ca5041d44" containerName="extract"
Jul 28 22:15:17.304949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.304881    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e8bff7b-abd6-489c-8277-48ef22b22f7a" containerName="extract"
Jul 28 22:15:17.313052 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.313026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.317620 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.317600    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 22:15:17.317769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.317708    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 22:15:17.318173 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.318156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 22:15:17.318927 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.318910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cltnz\""
Jul 28 22:15:17.326325 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.326307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 22:15:17.333669 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.333646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"]
Jul 28 22:15:17.373124 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.373032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:17.382032 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.381994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.382180 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.382146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8db188ef-61fc-47b2-8ee5-6705385675be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.382236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.382190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcx5d\" (UniqueName: \"kubernetes.io/projected/8db188ef-61fc-47b2-8ee5-6705385675be-kube-api-access-tcx5d\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.483208 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.483169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8db188ef-61fc-47b2-8ee5-6705385675be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.483208 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.483213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcx5d\" (UniqueName: \"kubernetes.io/projected/8db188ef-61fc-47b2-8ee5-6705385675be-kube-api-access-tcx5d\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.483423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.483242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.483423 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:15:17.483332    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 28 22:15:17.483423 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:15:17.483413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert podName:8db188ef-61fc-47b2-8ee5-6705385675be nodeName:}" failed. No retries permitted until 2026-07-28 22:15:17.9833968 +0000 UTC m=+645.295635769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-jtw2v" (UID: "8db188ef-61fc-47b2-8ee5-6705385675be") : secret "plugin-serving-cert" not found
Jul 28 22:15:17.483845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.483826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8db188ef-61fc-47b2-8ee5-6705385675be-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.494674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.494640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcx5d\" (UniqueName: \"kubernetes.io/projected/8db188ef-61fc-47b2-8ee5-6705385675be-kube-api-access-tcx5d\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.902902 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.902862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:17.987853 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.987817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:17.990255 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:17.990229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8db188ef-61fc-47b2-8ee5-6705385675be-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtw2v\" (UID: \"8db188ef-61fc-47b2-8ee5-6705385675be\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:18.222369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:18.222336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"
Jul 28 22:15:18.356621 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:18.356593    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v"]
Jul 28 22:15:18.358555 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:15:18.358523    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8db188ef_61fc_47b2_8ee5_6705385675be.slice/crio-7e715d324747340baa1832273e2774c53b66f450c54fe805d0bc2912aff310f0 WatchSource:0}: Error finding container 7e715d324747340baa1832273e2774c53b66f450c54fe805d0bc2912aff310f0: Status 404 returned error can't find the container with id 7e715d324747340baa1832273e2774c53b66f450c54fe805d0bc2912aff310f0
Jul 28 22:15:18.843546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:18.843512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v" event={"ID":"8db188ef-61fc-47b2-8ee5-6705385675be","Type":"ContainerStarted","Data":"7e715d324747340baa1832273e2774c53b66f450c54fe805d0bc2912aff310f0"}
Jul 28 22:15:21.595702 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:21.595659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:21.695914 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:21.695869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:29.170166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:29.170127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:29.275811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:29.275768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:29.372327 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:29.372295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:29.471947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:29.471902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:33.161567 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:33.161530    2563 scope.go:117] "RemoveContainer" containerID="ea361b2c4ef4d55eda61904c3f57bde7b630d1aaf78d9a3b58d9f0b29097f349"
Jul 28 22:15:34.091967 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:34.091924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:34.192792 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:34.192747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:37.884028 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:37.883979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:37.984663 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:37.984624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:38.084719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:38.084662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:38.168880 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:38.168756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:40.689502 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:40.689465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:40.790397 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:40.790363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:40.988110 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:40.988015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v" event={"ID":"8db188ef-61fc-47b2-8ee5-6705385675be","Type":"ContainerStarted","Data":"7410ffcb64abac3d44947e54e4ed5f40c37f95676ee6ae29d831ff9ab3b8ecf7"}
Jul 28 22:15:41.005816 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:41.005756    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtw2v" podStartSLOduration=2.391622725 podStartE2EDuration="24.005735884s" totalImagesPullingTime="21.614113159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:15:41.004501829 +0000 UTC m=+668.316740849" watchObservedRunningTime="2026-07-28 22:15:41.005735884 +0000 UTC m=+668.317974908"
Jul 28 22:15:51.337660 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:51.337617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:51.438349 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:51.438316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:54.774071 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:54.774037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:54.909802 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:54.909758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:58.771501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:58.771469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:58.871707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:58.871668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:59.372621 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:59.372573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:15:59.476356 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:15:59.476319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:00.259417 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:00.259379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:00.439818 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:00.439786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:03.593392 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:03.593357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:03.694899 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:03.694859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:09.841069 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:09.841026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:09.940732 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:09.940699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:14.598717 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:14.598680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:14.671283 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:14.671247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:14.767483 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:14.767442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:15.380022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.379987    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:15.383774 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.383751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:15.386103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.386080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pb829\""
Jul 28 22:16:15.389421 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.389388    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:15.415079 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.415047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:15.506003 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.505972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhpz\" (UniqueName: \"kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz\") pod \"authorino-58cd955675-jxmxn\" (UID: \"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6\") " pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:15.607474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.607437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhpz\" (UniqueName: \"kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz\") pod \"authorino-58cd955675-jxmxn\" (UID: \"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6\") " pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:15.624693 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.624660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhpz\" (UniqueName: \"kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz\") pod \"authorino-58cd955675-jxmxn\" (UID: \"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6\") " pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:15.649912 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.649839    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:15.653367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.653347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:15.668253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.668232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:15.694520 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.694502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:15.708016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.707988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94lqh\" (UniqueName: \"kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh\") pod \"authorino-75d556bd77-zv68l\" (UID: \"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1\") " pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:15.809411 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.809364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94lqh\" (UniqueName: \"kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh\") pod \"authorino-75d556bd77-zv68l\" (UID: \"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1\") " pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:15.822472 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.822445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94lqh\" (UniqueName: \"kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh\") pod \"authorino-75d556bd77-zv68l\" (UID: \"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1\") " pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:15.832836 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.832807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:15.834221 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:16:15.834190    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod238a8e68_9a8a_4b24_b85c_ec8b7b41cfe6.slice/crio-332263da5b46456162e1f36be64adb1c25cca50b92ef170847ea82ae4d3e7ec6 WatchSource:0}: Error finding container 332263da5b46456162e1f36be64adb1c25cca50b92ef170847ea82ae4d3e7ec6: Status 404 returned error can't find the container with id 332263da5b46456162e1f36be64adb1c25cca50b92ef170847ea82ae4d3e7ec6
Jul 28 22:16:15.962121 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:15.962087    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:16.092265 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:16.092239    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:16.093888 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:16:16.093860    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb6ce817_8d27_4d2d_8e4b_cf146ccef1e1.slice/crio-3cd413ec86ad717b689efb0c12c911c5890967a97812493f511685f334194eb1 WatchSource:0}: Error finding container 3cd413ec86ad717b689efb0c12c911c5890967a97812493f511685f334194eb1: Status 404 returned error can't find the container with id 3cd413ec86ad717b689efb0c12c911c5890967a97812493f511685f334194eb1
Jul 28 22:16:16.180160 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:16.180121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jxmxn" event={"ID":"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6","Type":"ContainerStarted","Data":"332263da5b46456162e1f36be64adb1c25cca50b92ef170847ea82ae4d3e7ec6"}
Jul 28 22:16:16.181335 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:16.181306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv68l" event={"ID":"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1","Type":"ContainerStarted","Data":"3cd413ec86ad717b689efb0c12c911c5890967a97812493f511685f334194eb1"}
Jul 28 22:16:16.204340 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:16.204316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:20.209179 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:20.209141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv68l" event={"ID":"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1","Type":"ContainerStarted","Data":"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"}
Jul 28 22:16:20.210629 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:20.210603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jxmxn" event={"ID":"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6","Type":"ContainerStarted","Data":"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"}
Jul 28 22:16:20.224801 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:20.224756    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zv68l" podStartSLOduration=2.068179944 podStartE2EDuration="5.22474257s" totalImagesPullingTime="3.156562626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:20.222788439 +0000 UTC m=+707.535027445" watchObservedRunningTime="2026-07-28 22:16:20.22474257 +0000 UTC m=+707.536981538"
Jul 28 22:16:20.239077 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:20.239032    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jxmxn" podStartSLOduration=1.837099255 podStartE2EDuration="5.239016823s" totalImagesPullingTime="3.401917568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:20.237555806 +0000 UTC m=+707.549794799" watchObservedRunningTime="2026-07-28 22:16:20.239016823 +0000 UTC m=+707.551255814"
Jul 28 22:16:20.259906 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:20.259877    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:22.221981 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:22.221922    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jxmxn" podUID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" containerName="authorino" containerID="cri-o://a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f" gracePeriod=30
Jul 28 22:16:22.465824 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:22.465799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:22.568774 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:22.568676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzhpz\" (UniqueName: \"kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz\") pod \"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6\" (UID: \"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6\") "
Jul 28 22:16:22.570756 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:22.570725    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz" (OuterVolumeSpecName: "kube-api-access-mzhpz") pod "238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" (UID: "238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6"). InnerVolumeSpecName "kube-api-access-mzhpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:16:22.669675 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:22.669622    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzhpz\" (UniqueName: \"kubernetes.io/projected/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6-kube-api-access-mzhpz\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:16:23.228973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.228936    2563 generic.go:356] "Generic (PLEG): container finished" podID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" containerID="a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f" exitCode=0
Jul 28 22:16:23.229424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.228982    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jxmxn"
Jul 28 22:16:23.229424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.229015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jxmxn" event={"ID":"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6","Type":"ContainerDied","Data":"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"}
Jul 28 22:16:23.229424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.229057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jxmxn" event={"ID":"238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6","Type":"ContainerDied","Data":"332263da5b46456162e1f36be64adb1c25cca50b92ef170847ea82ae4d3e7ec6"}
Jul 28 22:16:23.229424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.229075    2563 scope.go:117] "RemoveContainer" containerID="a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"
Jul 28 22:16:23.238275 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.238257    2563 scope.go:117] "RemoveContainer" containerID="a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"
Jul 28 22:16:23.238558 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:16:23.238536    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f\": container with ID starting with a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f not found: ID does not exist" containerID="a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"
Jul 28 22:16:23.238679 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.238565    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f"} err="failed to get container status \"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f\": rpc error: code = NotFound desc = could not find container \"a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f\": container with ID starting with a296344c510d4ed002a3c4bc51343de25cd67089b220f7a3c3907d4ff4d5d59f not found: ID does not exist"
Jul 28 22:16:23.254566 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.254541    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:23.261264 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:23.261234    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jxmxn"]
Jul 28 22:16:25.243723 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:25.243690    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" path="/var/lib/kubelet/pods/238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6/volumes"
Jul 28 22:16:33.456821 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:33.456787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:33.550263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:33.550232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:33.978889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:33.978848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:46.053686 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.053646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:46.250903 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.250869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:46.285751 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.285720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:46.286099 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.286087    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" containerName="authorino"
Jul 28 22:16:46.286147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.286101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" containerName="authorino"
Jul 28 22:16:46.286183 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.286165    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="238a8e68-9a8a-4b24-b85c-ec8b7b41cfe6" containerName="authorino"
Jul 28 22:16:46.290474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.290452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:46.294739 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.294714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:46.378980 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.378897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phzfn\" (UniqueName: \"kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn\") pod \"authorino-5d4b67c446-pccnv\" (UID: \"31b3cf88-aef6-4ead-8278-c14b7ca1abfe\") " pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:46.479364 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.479330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phzfn\" (UniqueName: \"kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn\") pod \"authorino-5d4b67c446-pccnv\" (UID: \"31b3cf88-aef6-4ead-8278-c14b7ca1abfe\") " pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:46.487119 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.487080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phzfn\" (UniqueName: \"kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn\") pod \"authorino-5d4b67c446-pccnv\" (UID: \"31b3cf88-aef6-4ead-8278-c14b7ca1abfe\") " pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:46.524255 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.524216    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:46.524481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.524469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:46.661252 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.661118    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:46.664039 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:16:46.664013    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31b3cf88_aef6_4ead_8278_c14b7ca1abfe.slice/crio-cbb9a4cf0d128819089f144a6a80ef37f40965ddaf86d7c6ad9008a99d817853 WatchSource:0}: Error finding container cbb9a4cf0d128819089f144a6a80ef37f40965ddaf86d7c6ad9008a99d817853: Status 404 returned error can't find the container with id cbb9a4cf0d128819089f144a6a80ef37f40965ddaf86d7c6ad9008a99d817853
Jul 28 22:16:46.748387 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.748351    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:16:46.753331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.753309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.755787 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.755763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 22:16:46.760747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.760724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:16:46.882992 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.882955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.883186 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.883023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdj9\" (UniqueName: \"kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.984061 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.984024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.984246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.984113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdj9\" (UniqueName: \"kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.986558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.986536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:46.994989 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:46.994964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdj9\" (UniqueName: \"kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9\") pod \"authorino-f67fccfcc-f8bsj\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") " pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:47.064708 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.064674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:16:47.200151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.200128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:16:47.202614 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:16:47.202568    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6b4145d_cf9e_4757_befe_742a1990b91c.slice/crio-f6391727761945d7e519d9c197803d94eb2b077895f2fde693868e6ec9759f32 WatchSource:0}: Error finding container f6391727761945d7e519d9c197803d94eb2b077895f2fde693868e6ec9759f32: Status 404 returned error can't find the container with id f6391727761945d7e519d9c197803d94eb2b077895f2fde693868e6ec9759f32
Jul 28 22:16:47.357347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.357230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pccnv" event={"ID":"31b3cf88-aef6-4ead-8278-c14b7ca1abfe","Type":"ContainerStarted","Data":"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"}
Jul 28 22:16:47.357347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.357291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pccnv" event={"ID":"31b3cf88-aef6-4ead-8278-c14b7ca1abfe","Type":"ContainerStarted","Data":"cbb9a4cf0d128819089f144a6a80ef37f40965ddaf86d7c6ad9008a99d817853"}
Jul 28 22:16:47.357347 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.357312    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-pccnv" podUID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" containerName="authorino" containerID="cri-o://99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45" gracePeriod=30
Jul 28 22:16:47.358557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.358526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" event={"ID":"c6b4145d-cf9e-4757-befe-742a1990b91c","Type":"ContainerStarted","Data":"f6391727761945d7e519d9c197803d94eb2b077895f2fde693868e6ec9759f32"}
Jul 28 22:16:47.383754 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.383709    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-pccnv" podStartSLOduration=0.889693866 podStartE2EDuration="1.3836926s" totalImagesPullingTime="493.998734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:47.382715302 +0000 UTC m=+734.694954294" watchObservedRunningTime="2026-07-28 22:16:47.3836926 +0000 UTC m=+734.695931590"
Jul 28 22:16:47.617344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.617284    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:47.790555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.790511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phzfn\" (UniqueName: \"kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn\") pod \"31b3cf88-aef6-4ead-8278-c14b7ca1abfe\" (UID: \"31b3cf88-aef6-4ead-8278-c14b7ca1abfe\") "
Jul 28 22:16:47.792672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.792637    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn" (OuterVolumeSpecName: "kube-api-access-phzfn") pod "31b3cf88-aef6-4ead-8278-c14b7ca1abfe" (UID: "31b3cf88-aef6-4ead-8278-c14b7ca1abfe"). InnerVolumeSpecName "kube-api-access-phzfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:16:47.891848 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:47.891761    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phzfn\" (UniqueName: \"kubernetes.io/projected/31b3cf88-aef6-4ead-8278-c14b7ca1abfe-kube-api-access-phzfn\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:16:48.365114 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.365080    2563 generic.go:356] "Generic (PLEG): container finished" podID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" containerID="99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45" exitCode=0
Jul 28 22:16:48.365653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.365127    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pccnv"
Jul 28 22:16:48.365653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.365173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pccnv" event={"ID":"31b3cf88-aef6-4ead-8278-c14b7ca1abfe","Type":"ContainerDied","Data":"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"}
Jul 28 22:16:48.365653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.365215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-pccnv" event={"ID":"31b3cf88-aef6-4ead-8278-c14b7ca1abfe","Type":"ContainerDied","Data":"cbb9a4cf0d128819089f144a6a80ef37f40965ddaf86d7c6ad9008a99d817853"}
Jul 28 22:16:48.365653 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.365248    2563 scope.go:117] "RemoveContainer" containerID="99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"
Jul 28 22:16:48.366825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.366803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" event={"ID":"c6b4145d-cf9e-4757-befe-742a1990b91c","Type":"ContainerStarted","Data":"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"}
Jul 28 22:16:48.375239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.375222    2563 scope.go:117] "RemoveContainer" containerID="99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"
Jul 28 22:16:48.375494 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:16:48.375474    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45\": container with ID starting with 99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45 not found: ID does not exist" containerID="99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"
Jul 28 22:16:48.375559 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.375501    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45"} err="failed to get container status \"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45\": rpc error: code = NotFound desc = could not find container \"99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45\": container with ID starting with 99971e3b2d44ff94ba810b5c4fdf9e8e8f57549a69d9ed50e68234893a10ae45 not found: ID does not exist"
Jul 28 22:16:48.385672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.385627    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" podStartSLOduration=2.01187648 podStartE2EDuration="2.385613121s" totalImagesPullingTime="373.736641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:48.385164826 +0000 UTC m=+735.697403817" watchObservedRunningTime="2026-07-28 22:16:48.385613121 +0000 UTC m=+735.697852108"
Jul 28 22:16:48.399823 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.399787    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:48.407144 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.407118    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pccnv"]
Jul 28 22:16:48.410801 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.410774    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:48.411011 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.410983    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zv68l" podUID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" containerName="authorino" containerID="cri-o://f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f" gracePeriod=30
Jul 28 22:16:48.660464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.660435    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:48.798699 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.798655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94lqh\" (UniqueName: \"kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh\") pod \"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1\" (UID: \"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1\") "
Jul 28 22:16:48.800767 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.800743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh" (OuterVolumeSpecName: "kube-api-access-94lqh") pod "db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" (UID: "db6ce817-8d27-4d2d-8e4b-cf146ccef1e1"). InnerVolumeSpecName "kube-api-access-94lqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:16:48.899541 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:48.899449    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94lqh\" (UniqueName: \"kubernetes.io/projected/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1-kube-api-access-94lqh\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:16:49.244686 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.244655    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" path="/var/lib/kubelet/pods/31b3cf88-aef6-4ead-8278-c14b7ca1abfe/volumes"
Jul 28 22:16:49.373629 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.373560    2563 generic.go:356] "Generic (PLEG): container finished" podID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" containerID="f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f" exitCode=0
Jul 28 22:16:49.373629 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.373626    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zv68l"
Jul 28 22:16:49.374151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.373648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv68l" event={"ID":"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1","Type":"ContainerDied","Data":"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"}
Jul 28 22:16:49.374151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.373694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zv68l" event={"ID":"db6ce817-8d27-4d2d-8e4b-cf146ccef1e1","Type":"ContainerDied","Data":"3cd413ec86ad717b689efb0c12c911c5890967a97812493f511685f334194eb1"}
Jul 28 22:16:49.374151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.373713    2563 scope.go:117] "RemoveContainer" containerID="f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"
Jul 28 22:16:49.382901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.382882    2563 scope.go:117] "RemoveContainer" containerID="f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"
Jul 28 22:16:49.383151 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:16:49.383135    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f\": container with ID starting with f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f not found: ID does not exist" containerID="f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"
Jul 28 22:16:49.383210 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.383160    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f"} err="failed to get container status \"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f\": rpc error: code = NotFound desc = could not find container \"f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f\": container with ID starting with f4b302c5169720fd4159f0e564c5a79051d0e4ef64b2daa8f0a89c4e8d2bbb0f not found: ID does not exist"
Jul 28 22:16:49.391402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.391376    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:49.393483 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:49.393465    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zv68l"]
Jul 28 22:16:51.243954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:51.243919    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" path="/var/lib/kubelet/pods/db6ce817-8d27-4d2d-8e4b-cf146ccef1e1/volumes"
Jul 28 22:16:53.081964 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:53.081929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:53.180102 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:53.180059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:53.231630 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:53.231571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:53.926625 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:53.926567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:57.010248 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:57.010211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:16:57.104263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:16:57.104225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:12.769640 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:12.769574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:29.070888 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:29.070852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:29.170619 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:29.170567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:29.657199 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:29.657164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:29.765682 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:29.765648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:30.152492 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.152448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:30.233343 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.233305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:30.280692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.280654    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4lcq"]
Jul 28 22:17:30.281130 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281110    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" containerName="authorino"
Jul 28 22:17:30.281234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281132    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" containerName="authorino"
Jul 28 22:17:30.281234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281171    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" containerName="authorino"
Jul 28 22:17:30.281234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281183    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" containerName="authorino"
Jul 28 22:17:30.281396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281289    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6ce817-8d27-4d2d-8e4b-cf146ccef1e1" containerName="authorino"
Jul 28 22:17:30.281396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.281308    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b3cf88-aef6-4ead-8278-c14b7ca1abfe" containerName="authorino"
Jul 28 22:17:30.284467 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.284445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.287498 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.287473    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-z2xh7\""
Jul 28 22:17:30.287726 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.287704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 22:17:30.294299 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.294272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4lcq"]
Jul 28 22:17:30.350692 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.350654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bfrm\" (UniqueName: \"kubernetes.io/projected/336b96bd-cd8e-41bf-b005-0119b3def24c-kube-api-access-2bfrm\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.351209 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.350921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/336b96bd-cd8e-41bf-b005-0119b3def24c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.452155 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.452115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bfrm\" (UniqueName: \"kubernetes.io/projected/336b96bd-cd8e-41bf-b005-0119b3def24c-kube-api-access-2bfrm\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.452328 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.452209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/336b96bd-cd8e-41bf-b005-0119b3def24c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.452920 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.452900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/336b96bd-cd8e-41bf-b005-0119b3def24c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.466312 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.466282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bfrm\" (UniqueName: \"kubernetes.io/projected/336b96bd-cd8e-41bf-b005-0119b3def24c-kube-api-access-2bfrm\") pod \"payload-processing-5cc6cd444b-l4lcq\" (UID: \"336b96bd-cd8e-41bf-b005-0119b3def24c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.596105 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.596055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:30.730846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:30.730673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4lcq"]
Jul 28 22:17:30.733926 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:17:30.733896    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336b96bd_cd8e_41bf_b005_0119b3def24c.slice/crio-ef968be9fd5d8d069618787cd20218459508140f5a8e88f7aa75ae54924e92a9 WatchSource:0}: Error finding container ef968be9fd5d8d069618787cd20218459508140f5a8e88f7aa75ae54924e92a9: Status 404 returned error can't find the container with id ef968be9fd5d8d069618787cd20218459508140f5a8e88f7aa75ae54924e92a9
Jul 28 22:17:31.610434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:31.610373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq" event={"ID":"336b96bd-cd8e-41bf-b005-0119b3def24c","Type":"ContainerStarted","Data":"ef968be9fd5d8d069618787cd20218459508140f5a8e88f7aa75ae54924e92a9"}
Jul 28 22:17:32.626201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:32.626098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq" event={"ID":"336b96bd-cd8e-41bf-b005-0119b3def24c","Type":"ContainerStarted","Data":"cc347b99da32cc05622ad7cae89e4aabe157e38891899627a43c3e7110da5eec"}
Jul 28 22:17:32.626570 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:32.626266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:32.643161 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:32.643113    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq" podStartSLOduration=1.157081314 podStartE2EDuration="2.643098027s" totalImagesPullingTime="1.486016713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:17:32.640705674 +0000 UTC m=+779.952944666" watchObservedRunningTime="2026-07-28 22:17:32.643098027 +0000 UTC m=+779.955337017"
Jul 28 22:17:40.625434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:40.625400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:40.725031 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:40.724983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:43.633428 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:43.633398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-l4lcq"
Jul 28 22:17:46.309247 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:46.309192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:58.967341 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.967259    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"]
Jul 28 22:17:58.970765 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.970747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.974854 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.974826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 22:17:58.974854 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.974849    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 22:17:58.975058 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.974868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 22:17:58.975058 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.974877    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lntbc\""
Jul 28 22:17:58.981311 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.981289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"]
Jul 28 22:17:58.993388 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.993523 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.993523 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.993523 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qjr\" (UniqueName: \"kubernetes.io/projected/71ae63b0-5624-4263-bc51-9a6c150049f1-kube-api-access-v6qjr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.993523 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71ae63b0-5624-4263-bc51-9a6c150049f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:58.993681 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:58.993606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094835 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094835 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094835 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qjr\" (UniqueName: \"kubernetes.io/projected/71ae63b0-5624-4263-bc51-9a6c150049f1-kube-api-access-v6qjr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.094835 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71ae63b0-5624-4263-bc51-9a6c150049f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.095051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.095051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.094985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.095051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.095026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.096860 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.096842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71ae63b0-5624-4263-bc51-9a6c150049f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.097355 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.097335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71ae63b0-5624-4263-bc51-9a6c150049f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.104041 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.104006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:17:59.105130 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.105105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qjr\" (UniqueName: \"kubernetes.io/projected/71ae63b0-5624-4263-bc51-9a6c150049f1-kube-api-access-v6qjr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zblmr\" (UID: \"71ae63b0-5624-4263-bc51-9a6c150049f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.282317 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.282223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:17:59.420507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.420479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"]
Jul 28 22:17:59.422493 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:17:59.422458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ae63b0_5624_4263_bc51_9a6c150049f1.slice/crio-59745f3396105b525ba8c13edda2a42a1c2ba9d3d3cf23705d88b6d9bbeb891b WatchSource:0}: Error finding container 59745f3396105b525ba8c13edda2a42a1c2ba9d3d3cf23705d88b6d9bbeb891b: Status 404 returned error can't find the container with id 59745f3396105b525ba8c13edda2a42a1c2ba9d3d3cf23705d88b6d9bbeb891b
Jul 28 22:17:59.783607 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:17:59.783556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr" event={"ID":"71ae63b0-5624-4263-bc51-9a6c150049f1","Type":"ContainerStarted","Data":"59745f3396105b525ba8c13edda2a42a1c2ba9d3d3cf23705d88b6d9bbeb891b"}
Jul 28 22:18:00.791070 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:00.790975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr" event={"ID":"71ae63b0-5624-4263-bc51-9a6c150049f1","Type":"ContainerStarted","Data":"031ccc24e20acb5f5867874032c26c42bedc609ca5ef1ba629987e5de72cd0bf"}
Jul 28 22:18:00.809027 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:00.808973    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr" podStartSLOduration=1.7435973009999999 podStartE2EDuration="2.808950777s" totalImagesPullingTime="1.065353476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:18:00.80789872 +0000 UTC m=+808.120137711" watchObservedRunningTime="2026-07-28 22:18:00.808950777 +0000 UTC m=+808.121189769"
Jul 28 22:18:08.976985 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:08.976953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:18:09.283368 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:09.283278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:18:09.283368 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:09.283339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:18:09.295852 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:09.295821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:18:09.852754 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:09.852725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zblmr"
Jul 28 22:18:23.874597 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:23.874553    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"]
Jul 28 22:18:23.878260 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:23.878242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:23.880881 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:23.880863    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 22:18:23.886377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:23.886356    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"]
Jul 28 22:18:23.894772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:23.894752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:18:24.022590 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.022766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfpbz\" (UniqueName: \"kubernetes.io/projected/91cae49c-0658-440a-8d4e-add5dec9a87c-kube-api-access-bfpbz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.022766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.022766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.022766 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cae49c-0658-440a-8d4e-add5dec9a87c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.022952 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.022811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124067 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124067 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpbz\" (UniqueName: \"kubernetes.io/projected/91cae49c-0658-440a-8d4e-add5dec9a87c-kube-api-access-bfpbz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124276 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124276 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124368 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cae49c-0658-440a-8d4e-add5dec9a87c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124493 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.124778 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.124732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.126641 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.126614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cae49c-0658-440a-8d4e-add5dec9a87c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.126767 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.126750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cae49c-0658-440a-8d4e-add5dec9a87c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.131912 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.131885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfpbz\" (UniqueName: \"kubernetes.io/projected/91cae49c-0658-440a-8d4e-add5dec9a87c-kube-api-access-bfpbz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg\" (UID: \"91cae49c-0658-440a-8d4e-add5dec9a87c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.188720 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.188695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:24.322164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.322135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"]
Jul 28 22:18:24.324045 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:18:24.324019    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cae49c_0658_440a_8d4e_add5dec9a87c.slice/crio-cf79b1e2f428dbda6c0c6a00e3288686dbc5ee4fbabcdde37136b53c26581b0d WatchSource:0}: Error finding container cf79b1e2f428dbda6c0c6a00e3288686dbc5ee4fbabcdde37136b53c26581b0d: Status 404 returned error can't find the container with id cf79b1e2f428dbda6c0c6a00e3288686dbc5ee4fbabcdde37136b53c26581b0d
Jul 28 22:18:24.925429 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.925336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg" event={"ID":"91cae49c-0658-440a-8d4e-add5dec9a87c","Type":"ContainerStarted","Data":"30f5c7ddba87a3fbc18e0235788116f7b5695ebc6cb68c22d267d4a94dd7002a"}
Jul 28 22:18:24.925429 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.925389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg" event={"ID":"91cae49c-0658-440a-8d4e-add5dec9a87c","Type":"ContainerStarted","Data":"cf79b1e2f428dbda6c0c6a00e3288686dbc5ee4fbabcdde37136b53c26581b0d"}
Jul 28 22:18:24.947072 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:24.947010    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg" podStartSLOduration=1.7500779020000001 podStartE2EDuration="1.946994256s" totalImagesPullingTime="196.916354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:18:24.944850954 +0000 UTC m=+832.257089944" watchObservedRunningTime="2026-07-28 22:18:24.946994256 +0000 UTC m=+832.259233246"
Jul 28 22:18:34.189642 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:34.189566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:34.190161 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:34.189672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:34.202532 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:34.202504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:34.990820 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:34.990791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg"
Jul 28 22:18:37.799417 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:37.799386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:18:55.015155 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:18:55.015110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:19:33.194476 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:33.194442    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:19:33.198286 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:33.198258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:19:56.931434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:56.931400    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9b58cd76-rxpfs"]
Jul 28 22:19:56.934956 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:56.934939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:56.941049 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:56.941021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b58cd76-rxpfs"]
Jul 28 22:19:57.073298 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.073265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6krs8\" (UniqueName: \"kubernetes.io/projected/e5dc20f0-1a36-4edb-960a-feb29f3896e0-kube-api-access-6krs8\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.073477 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.073399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5dc20f0-1a36-4edb-960a-feb29f3896e0-tls-cert\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.174449 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.174411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5dc20f0-1a36-4edb-960a-feb29f3896e0-tls-cert\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.174652 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.174462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6krs8\" (UniqueName: \"kubernetes.io/projected/e5dc20f0-1a36-4edb-960a-feb29f3896e0-kube-api-access-6krs8\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.176910 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.176883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5dc20f0-1a36-4edb-960a-feb29f3896e0-tls-cert\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.182700 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.182645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6krs8\" (UniqueName: \"kubernetes.io/projected/e5dc20f0-1a36-4edb-960a-feb29f3896e0-kube-api-access-6krs8\") pod \"authorino-9b58cd76-rxpfs\" (UID: \"e5dc20f0-1a36-4edb-960a-feb29f3896e0\") " pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.245683 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.245647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9b58cd76-rxpfs"
Jul 28 22:19:57.344245 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.344210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:19:57.388644 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.388615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9b58cd76-rxpfs"]
Jul 28 22:19:57.390550 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:19:57.390524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5dc20f0_1a36_4edb_960a_feb29f3896e0.slice/crio-d0a557118ec942f7564e11cd997cfa71440e09464fccea43458dd81e3da741e1 WatchSource:0}: Error finding container d0a557118ec942f7564e11cd997cfa71440e09464fccea43458dd81e3da741e1: Status 404 returned error can't find the container with id d0a557118ec942f7564e11cd997cfa71440e09464fccea43458dd81e3da741e1
Jul 28 22:19:57.392001 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.391983    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:19:57.443073 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.442984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b58cd76-rxpfs" event={"ID":"e5dc20f0-1a36-4edb-960a-feb29f3896e0","Type":"ContainerStarted","Data":"d0a557118ec942f7564e11cd997cfa71440e09464fccea43458dd81e3da741e1"}
Jul 28 22:19:57.443230 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:57.443174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:19:58.452301 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.452256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9b58cd76-rxpfs" event={"ID":"e5dc20f0-1a36-4edb-960a-feb29f3896e0","Type":"ContainerStarted","Data":"1bd3496f8597197028a61d22d8e2d0f4412cc4e4cd1829b473c4f612da9b1b7d"}
Jul 28 22:19:58.530103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.527946    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9b58cd76-rxpfs" podStartSLOduration=2.006748097 podStartE2EDuration="2.527924692s" totalImagesPullingTime="521.176595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:19:58.493827915 +0000 UTC m=+925.806066910" watchObservedRunningTime="2026-07-28 22:19:58.527924692 +0000 UTC m=+925.840163684"
Jul 28 22:19:58.530103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.528873    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:19:58.530103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.529052    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" podUID="c6b4145d-cf9e-4757-befe-742a1990b91c" containerName="authorino" containerID="cri-o://0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756" gracePeriod=30
Jul 28 22:19:58.543234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.543156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:19:58.623526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.623496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:19:58.800331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.800296    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:19:58.890080 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.890045    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert\") pod \"c6b4145d-cf9e-4757-befe-742a1990b91c\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") "
Jul 28 22:19:58.890272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.890095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbdj9\" (UniqueName: \"kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9\") pod \"c6b4145d-cf9e-4757-befe-742a1990b91c\" (UID: \"c6b4145d-cf9e-4757-befe-742a1990b91c\") "
Jul 28 22:19:58.892204 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.892164    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9" (OuterVolumeSpecName: "kube-api-access-vbdj9") pod "c6b4145d-cf9e-4757-befe-742a1990b91c" (UID: "c6b4145d-cf9e-4757-befe-742a1990b91c"). InnerVolumeSpecName "kube-api-access-vbdj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:19:58.903253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.903223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c6b4145d-cf9e-4757-befe-742a1990b91c" (UID: "c6b4145d-cf9e-4757-befe-742a1990b91c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:19:58.991552 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.991464    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbdj9\" (UniqueName: \"kubernetes.io/projected/c6b4145d-cf9e-4757-befe-742a1990b91c-kube-api-access-vbdj9\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:19:58.991552 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:58.991499    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6b4145d-cf9e-4757-befe-742a1990b91c-tls-cert\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:19:59.460098 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.460060    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6b4145d-cf9e-4757-befe-742a1990b91c" containerID="0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756" exitCode=0
Jul 28 22:19:59.460605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.460122    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f67fccfcc-f8bsj"
Jul 28 22:19:59.460605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.460145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" event={"ID":"c6b4145d-cf9e-4757-befe-742a1990b91c","Type":"ContainerDied","Data":"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"}
Jul 28 22:19:59.460605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.460205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f67fccfcc-f8bsj" event={"ID":"c6b4145d-cf9e-4757-befe-742a1990b91c","Type":"ContainerDied","Data":"f6391727761945d7e519d9c197803d94eb2b077895f2fde693868e6ec9759f32"}
Jul 28 22:19:59.460605 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.460231    2563 scope.go:117] "RemoveContainer" containerID="0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"
Jul 28 22:19:59.480805 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.480780    2563 scope.go:117] "RemoveContainer" containerID="0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"
Jul 28 22:19:59.481172 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:19:59.481148    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756\": container with ID starting with 0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756 not found: ID does not exist" containerID="0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"
Jul 28 22:19:59.481259 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.481185    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756"} err="failed to get container status \"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756\": rpc error: code = NotFound desc = could not find container \"0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756\": container with ID starting with 0e3d7b953d71af8c077a0d2e8da4cb3ebb3684fa1ffb094f61b6ea9095080756 not found: ID does not exist"
Jul 28 22:19:59.483032 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.483008    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:19:59.488524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:19:59.488491    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f67fccfcc-f8bsj"]
Jul 28 22:20:01.244297 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:20:01.244260    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b4145d-cf9e-4757-befe-742a1990b91c" path="/var/lib/kubelet/pods/c6b4145d-cf9e-4757-befe-742a1990b91c/volumes"
Jul 28 22:21:05.964173 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:05.964071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:10.249915 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:10.249877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:10.297498 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:10.297462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:18.106156 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:18.106116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:18.216938 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:18.216896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:19.771132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:19.771086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:21:19.871363 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:21:19.871332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:03.702239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:03.702200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:04.935666 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:04.935626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:44.638673 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:44.638640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:44.736365 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:44.736332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:44.872472 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:44.872412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:50.509216 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:50.509169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:50.568878 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:50.568840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:50.641987 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:50.641955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:50.741858 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:50.741818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:50.858258 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:50.858159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:56.510986 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:56.510951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:22:56.581419 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:22:56.581387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:23:17.887386 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:23:17.887348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:23:17.988812 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:23:17.988775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:23:34.654128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:23:34.654085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:24:33.231559 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:24:33.231475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:24:33.237773 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:24:33.237739    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:24:48.348864 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:24:48.348825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:28:26.328105 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:28:26.328019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:28:27.592387 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:28:27.592332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:28:40.934989 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:28:40.934945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:28:53.225201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:28:53.225132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:29:01.382995 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:29:01.382963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:29:33.268515 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:29:33.268484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:29:33.276905 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:29:33.276878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:30:00.146455 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.146378    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"]
Jul 28 22:30:00.146845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.146802    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b4145d-cf9e-4757-befe-742a1990b91c" containerName="authorino"
Jul 28 22:30:00.146845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.146815    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b4145d-cf9e-4757-befe-742a1990b91c" containerName="authorino"
Jul 28 22:30:00.146925 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.146891    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b4145d-cf9e-4757-befe-742a1990b91c" containerName="authorino"
Jul 28 22:30:00.149930 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.149915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"
Jul 28 22:30:00.153051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.153030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:30:00.160003 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.159979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"
Jul 28 22:30:00.162091 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.162070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"]
Jul 28 22:30:00.295289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.295266    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"]
Jul 28 22:30:00.297030 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:30:00.297002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20ef818_58ce_46f7_9166_222b275f5c19.slice/crio-5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0 WatchSource:0}: Error finding container 5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0: Status 404 returned error can't find the container with id 5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0
Jul 28 22:30:00.298850 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.298832    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:30:00.779783 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:00.779739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr" event={"ID":"d20ef818-58ce-46f7-9166-222b275f5c19","Type":"ContainerStarted","Data":"5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0"}
Jul 28 22:30:04.802652 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:04.802610    2563 generic.go:356] "Generic (PLEG): container finished" podID="d20ef818-58ce-46f7-9166-222b275f5c19" containerID="1c21dce11236f4080e9abd61c61a2b404e8f13a7ecd0a191a756be90c03ed01a" exitCode=0
Jul 28 22:30:04.803065 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:04.802705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr" event={"ID":"d20ef818-58ce-46f7-9166-222b275f5c19","Type":"ContainerDied","Data":"1c21dce11236f4080e9abd61c61a2b404e8f13a7ecd0a191a756be90c03ed01a"}
Jul 28 22:30:05.939036 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:05.939012    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"
Jul 28 22:30:06.814614 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:06.814572    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr"
Jul 28 22:30:06.814614 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:06.814598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754630-dghvr" event={"ID":"d20ef818-58ce-46f7-9166-222b275f5c19","Type":"ContainerDied","Data":"5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0"}
Jul 28 22:30:06.814831 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:30:06.814667    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c6f75ce5bd774969223bf1588e59769ecd50feb7f1210e59e64337b7f89dfb0"
Jul 28 22:31:09.492366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:31:09.492333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:31:22.405314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:31:22.405276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:31:48.737455 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:31:48.737420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:31:49.734086 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:31:49.734050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:33:01.133129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:33:01.133044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:34:27.584890 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:34:27.584804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:34:33.318252 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:34:33.318217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:34:33.325532 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:34:33.325501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:35:05.069181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:05.069133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:26.750813 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:26.750772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:29.276956 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:29.276917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:29.828489 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:29.828452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:29.929381 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:29.929345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:30.336100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:30.336061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:36.076590 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:36.076550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:36.178211 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:36.178176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:36.309171 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:36.309132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:36.651430 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:36.651382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:37.282194 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:37.282157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:38.565546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:38.565510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:38.664718 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:38.664681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:38.832062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:38.831976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:39.027302 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:39.027266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:39.348198 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:39.348161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:35:39.451908 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:35:39.451871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:04.174698 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.174612    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"]
Jul 28 22:36:04.175098 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.175017    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20ef818-58ce-46f7-9166-222b275f5c19" containerName="cleanup"
Jul 28 22:36:04.175098 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.175028    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20ef818-58ce-46f7-9166-222b275f5c19" containerName="cleanup"
Jul 28 22:36:04.175184 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.175105    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20ef818-58ce-46f7-9166-222b275f5c19" containerName="cleanup"
Jul 28 22:36:04.178194 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.178177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:04.182331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.182304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:36:04.182331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.182304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:36:04.184223 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.184195    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"]
Jul 28 22:36:04.289633 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.289574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc\" (UID: \"d847d950-89c6-4867-b34a-7c491416bef8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:04.390929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.390886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc\" (UID: \"d847d950-89c6-4867-b34a-7c491416bef8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:04.391646 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.391626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc\" (UID: \"d847d950-89c6-4867-b34a-7c491416bef8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:04.490269 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.490234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:04.622044 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.622006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"]
Jul 28 22:36:04.624648 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:36:04.624618    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd847d950_89c6_4867_b34a_7c491416bef8.slice/crio-f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f WatchSource:0}: Error finding container f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f: Status 404 returned error can't find the container with id f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f
Jul 28 22:36:04.843822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:04.843785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc" event={"ID":"d847d950-89c6-4867-b34a-7c491416bef8","Type":"ContainerStarted","Data":"f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f"}
Jul 28 22:36:05.853748 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:05.853705    2563 generic.go:356] "Generic (PLEG): container finished" podID="d847d950-89c6-4867-b34a-7c491416bef8" containerID="a612e211d8c1df1f46062949bf1090e264facc11b8e4327ad434019f026dcbbd" exitCode=0
Jul 28 22:36:05.854169 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:05.853769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc" event={"ID":"d847d950-89c6-4867-b34a-7c491416bef8","Type":"ContainerDied","Data":"a612e211d8c1df1f46062949bf1090e264facc11b8e4327ad434019f026dcbbd"}
Jul 28 22:36:06.997377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:06.997349    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:07.113988 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.113886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca\") pod \"d847d950-89c6-4867-b34a-7c491416bef8\" (UID: \"d847d950-89c6-4867-b34a-7c491416bef8\") "
Jul 28 22:36:07.114286 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.114263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d847d950-89c6-4867-b34a-7c491416bef8" (UID: "d847d950-89c6-4867-b34a-7c491416bef8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:36:07.215046 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.215010    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d847d950-89c6-4867-b34a-7c491416bef8-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:36:07.867055 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.867022    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"
Jul 28 22:36:07.867263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.867055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc" event={"ID":"d847d950-89c6-4867-b34a-7c491416bef8","Type":"ContainerDied","Data":"f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f"}
Jul 28 22:36:07.867263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:07.867105    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f176d9e7d8ed46c5c502b677b2581b2e49d7eeb1ae6182c4193cb1580ffd162f"
Jul 28 22:36:09.418934 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.418902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:09.497820 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.497703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:09.567238 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.567196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:09.609022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.608985    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"]
Jul 28 22:36:09.611811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.611787    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7833e2f6-2g4zc"]
Jul 28 22:36:09.624826 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.624788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:09.769260 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:09.769220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:10.001370 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:10.001327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:10.300559 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:10.300518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:10.392919 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:10.392881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:10.496305 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:10.496264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:10.839217 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:10.839177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:11.244637 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:11.244606    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d847d950-89c6-4867-b34a-7c491416bef8" path="/var/lib/kubelet/pods/d847d950-89c6-4867-b34a-7c491416bef8/volumes"
Jul 28 22:36:11.518861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:11.518780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.042049 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.042011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.172514 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.172473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.498297 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.498260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.702052 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.701999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.796439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.796351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:13.881950 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.881921    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:13.882316 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.882303    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d847d950-89c6-4867-b34a-7c491416bef8" containerName="revoke-keys"
Jul 28 22:36:13.882364 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.882317    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d847d950-89c6-4867-b34a-7c491416bef8" containerName="revoke-keys"
Jul 28 22:36:13.882399 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.882383    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d847d950-89c6-4867-b34a-7c491416bef8" containerName="revoke-keys"
Jul 28 22:36:13.885675 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.885655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:13.888640 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.888622    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-72a5477c-dockercfg-7szm8\""
Jul 28 22:36:13.888724 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.888654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-72a5477c\""
Jul 28 22:36:13.894897 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.894872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:13.975170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.975133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:13.975354 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:13.975197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jf48\" (UniqueName: \"kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.076069 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.075940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.076632 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.076082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jf48\" (UniqueName: \"kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.077201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.077181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.085635 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.085610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jf48\" (UniqueName: \"kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48\") pod \"payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.197936 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.197899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.335683 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.335642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:14.337668 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:36:14.337635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fe7c8f_2020_4ccd_b82f_2b2cbfecb75a.slice/crio-25fc1e0f4718767103fa0d9fe8c5162bd5acda27a1e1b49c982c716c543fa505 WatchSource:0}: Error finding container 25fc1e0f4718767103fa0d9fe8c5162bd5acda27a1e1b49c982c716c543fa505: Status 404 returned error can't find the container with id 25fc1e0f4718767103fa0d9fe8c5162bd5acda27a1e1b49c982c716c543fa505
Jul 28 22:36:14.913834 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.913798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" event={"ID":"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a","Type":"ContainerStarted","Data":"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"}
Jul 28 22:36:14.914016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.913851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" event={"ID":"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a","Type":"ContainerStarted","Data":"25fc1e0f4718767103fa0d9fe8c5162bd5acda27a1e1b49c982c716c543fa505"}
Jul 28 22:36:14.914016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.913893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:14.929701 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:14.929641    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" podStartSLOduration=1.929619849 podStartE2EDuration="1.929619849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:36:14.929172914 +0000 UTC m=+1902.241411907" watchObservedRunningTime="2026-07-28 22:36:14.929619849 +0000 UTC m=+1902.241858893"
Jul 28 22:36:25.922609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:25.922546    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:44.604543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.604500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:44.639903 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.639866    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:44.640126 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.640086    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" podUID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" containerName="payload-pre-processing" containerID="cri-o://50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c" gracePeriod=30
Jul 28 22:36:44.705056 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.705022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:44.770965 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.770931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:44.832211 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.832156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:44.920246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.907178    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:44.941555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:44.941500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:45.045813 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.045782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume\") pod \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") "
Jul 28 22:36:45.045997 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.045840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jf48\" (UniqueName: \"kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48\") pod \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\" (UID: \"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a\") "
Jul 28 22:36:45.046272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.046246    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" (UID: "17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:36:45.047958 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.047936    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48" (OuterVolumeSpecName: "kube-api-access-4jf48") pod "17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" (UID: "17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a"). InnerVolumeSpecName "kube-api-access-4jf48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:36:45.091416 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.091383    2563 generic.go:356] "Generic (PLEG): container finished" podID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" containerID="50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c" exitCode=0
Jul 28 22:36:45.091558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.091428    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"
Jul 28 22:36:45.091558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.091459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" event={"ID":"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a","Type":"ContainerDied","Data":"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"}
Jul 28 22:36:45.091558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.091512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx" event={"ID":"17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a","Type":"ContainerDied","Data":"25fc1e0f4718767103fa0d9fe8c5162bd5acda27a1e1b49c982c716c543fa505"}
Jul 28 22:36:45.091558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.091538    2563 scope.go:117] "RemoveContainer" containerID="50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"
Jul 28 22:36:45.100925 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.100908    2563 scope.go:117] "RemoveContainer" containerID="50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"
Jul 28 22:36:45.101177 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:36:45.101158    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c\": container with ID starting with 50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c not found: ID does not exist" containerID="50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"
Jul 28 22:36:45.101234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.101186    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c"} err="failed to get container status \"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c\": rpc error: code = NotFound desc = could not find container \"50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c\": container with ID starting with 50615e84d6455ca01106a31104b527010168f6125445e045ccae91cf037e2f3c not found: ID does not exist"
Jul 28 22:36:45.114623 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.114596    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:45.118129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.118107    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-72a5477c-59c8d45c5b-6ntsx"]
Jul 28 22:36:45.147021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.146950    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:36:45.147021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.146978    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jf48\" (UniqueName: \"kubernetes.io/projected/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a-kube-api-access-4jf48\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:36:45.158369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.158337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:45.251327 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.251293    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" path="/var/lib/kubelet/pods/17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a/volumes"
Jul 28 22:36:45.392930 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.392893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:45.704698 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.704667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:45.866318 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:45.866287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.013142 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.013106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.113902 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.113865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.204810 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.204780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.440203 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.440176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.810386 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.810284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:36:48.897073 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:36:48.897041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:13.728797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.728764    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"]
Jul 28 22:37:13.729366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.729210    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" containerName="payload-pre-processing"
Jul 28 22:37:13.729366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.729225    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" containerName="payload-pre-processing"
Jul 28 22:37:13.729366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.729295    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="17fe7c8f-2020-4ccd-b82f-2b2cbfecb75a" containerName="payload-pre-processing"
Jul 28 22:37:13.732496 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.732475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:13.735132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.735099    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:37:13.735262 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.735188    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:37:13.740455 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.740418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"]
Jul 28 22:37:13.802278 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.802239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b99011fa-lffls\" (UID: \"d8617fbc-33ee-475c-b238-0ec8d7f5fb47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:13.909218 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.909156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b99011fa-lffls\" (UID: \"d8617fbc-33ee-475c-b238-0ec8d7f5fb47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:13.910245 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:13.910212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b99011fa-lffls\" (UID: \"d8617fbc-33ee-475c-b238-0ec8d7f5fb47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:14.046481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:14.046399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:14.181868 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:14.181843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"]
Jul 28 22:37:14.183729 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:37:14.183701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8617fbc_33ee_475c_b238_0ec8d7f5fb47.slice/crio-7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291 WatchSource:0}: Error finding container 7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291: Status 404 returned error can't find the container with id 7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291
Jul 28 22:37:14.252794 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:14.252762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls" event={"ID":"d8617fbc-33ee-475c-b238-0ec8d7f5fb47","Type":"ContainerStarted","Data":"7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291"}
Jul 28 22:37:15.259460 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:15.259414    2563 generic.go:356] "Generic (PLEG): container finished" podID="d8617fbc-33ee-475c-b238-0ec8d7f5fb47" containerID="0d0311ad41e5b6ff37214543dadf961c755c806d3687e7edbcf8ce25971717b9" exitCode=0
Jul 28 22:37:15.259900 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:15.259475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls" event={"ID":"d8617fbc-33ee-475c-b238-0ec8d7f5fb47","Type":"ContainerDied","Data":"0d0311ad41e5b6ff37214543dadf961c755c806d3687e7edbcf8ce25971717b9"}
Jul 28 22:37:16.414111 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:16.414085    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:16.530334 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:16.530242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca\") pod \"d8617fbc-33ee-475c-b238-0ec8d7f5fb47\" (UID: \"d8617fbc-33ee-475c-b238-0ec8d7f5fb47\") "
Jul 28 22:37:16.530600 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:16.530560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8617fbc-33ee-475c-b238-0ec8d7f5fb47" (UID: "d8617fbc-33ee-475c-b238-0ec8d7f5fb47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:37:16.631762 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:16.631728    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8617fbc-33ee-475c-b238-0ec8d7f5fb47-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:37:17.271551 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:17.271520    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"
Jul 28 22:37:17.271750 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:17.271550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls" event={"ID":"d8617fbc-33ee-475c-b238-0ec8d7f5fb47","Type":"ContainerDied","Data":"7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291"}
Jul 28 22:37:17.271750 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:17.271629    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b7120e49772d8f517ec8ab8527f348274c4198e0e7e27c5e18b2835c0cb3291"
Jul 28 22:37:18.840228 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:18.840194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:18.930041 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:18.930006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:19.033151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:19.033112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:19.034609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:19.034571    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"]
Jul 28 22:37:19.036739 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:19.036718    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b99011fa-lffls"]
Jul 28 22:37:19.092690 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:19.092611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:19.245731 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:19.245691    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8617fbc-33ee-475c-b238-0ec8d7f5fb47" path="/var/lib/kubelet/pods/d8617fbc-33ee-475c-b238-0ec8d7f5fb47/volumes"
Jul 28 22:37:20.210197 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:20.210159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:20.428236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:20.428202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:20.661337 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:20.661241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:20.956643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:20.956600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:21.174063 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:21.174025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.140991 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.140947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.229284 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.229239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.292022 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.291992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.444742 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.444704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.721514 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.721414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:23.822631 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:23.822565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:43.874053 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:43.874017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:43.940167 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:43.940120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:43.997359 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:43.997323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:44.055275 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:44.055236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:44.183305 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:44.183269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:44.421591 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:44.421544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:44.889689 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:44.889628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:44.984527 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:44.984495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:45.084969 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:45.084933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:46.537604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:46.537552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:52.814285 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:52.814250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:52.915736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:52.915692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:53.019296 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:53.019261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:53.114977 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:53.114877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:37:53.529314 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:37:53.529274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:19.496616 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:19.496553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:23.422018 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:23.421979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:23.520299 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:23.520261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:25.664732 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:25.664690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:25.767891 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:25.767859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:25.891315 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:25.891281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:41.811187 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:41.811152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:47.667183 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:47.667119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:47.727132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:47.727092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:47.806725 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:47.806681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:47.902902 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:47.902861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:58.379011 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:58.378933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:38:59.182493 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:38:59.182455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:05.169273 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:05.169225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:05.293806 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:05.293765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:05.447709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:05.447676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:05.546335 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:05.546298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:12.751034 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:12.750988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:12.848711 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:12.848676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:12.947530 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:12.947498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:14.728525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:14.728485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:20.443429 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:20.443385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:20.496820 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:20.496783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:21.156705 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:21.156670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:26.955620 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:26.955568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:27.067474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:27.067440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:27.245128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:27.245032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:27.558390 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:27.558296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:27.752286 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:27.752242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:30.477451 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:30.477413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:31.708507 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:31.708461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:33.366455 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:33.366422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:39:33.377440 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:33.377410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:39:50.352795 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:50.352765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:55.340595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:55.340536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:56.014081 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:56.014040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:56.126161 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:56.126122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:39:56.503249 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:39:56.503208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:02.098128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.098085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:02.157177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.157143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:02.475932 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.475900    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"]
Jul 28 22:40:02.476311 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.476298    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8617fbc-33ee-475c-b238-0ec8d7f5fb47" containerName="revoke-keys"
Jul 28 22:40:02.476361 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.476312    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8617fbc-33ee-475c-b238-0ec8d7f5fb47" containerName="revoke-keys"
Jul 28 22:40:02.476396 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.476383    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8617fbc-33ee-475c-b238-0ec8d7f5fb47" containerName="revoke-keys"
Jul 28 22:40:02.479566 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.479550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:02.482230 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.482210    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:40:02.482365 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.482313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:40:02.487108 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.487082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"]
Jul 28 22:40:02.641108 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.641072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6\" (UID: \"1b6804b3-b204-44e3-976f-453bdc04b64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:02.742409 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.742335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6\" (UID: \"1b6804b3-b204-44e3-976f-453bdc04b64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:02.742957 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.742935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6\" (UID: \"1b6804b3-b204-44e3-976f-453bdc04b64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:02.792242 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.792213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:02.925875 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:02.925844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"]
Jul 28 22:40:02.927902 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:40:02.927876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6804b3_b204_44e3_976f_453bdc04b64c.slice/crio-419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919 WatchSource:0}: Error finding container 419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919: Status 404 returned error can't find the container with id 419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919
Jul 28 22:40:03.218934 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:03.218897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6" event={"ID":"1b6804b3-b204-44e3-976f-453bdc04b64c","Type":"ContainerStarted","Data":"17d65f4e3825524a8e2443dfd30ee959c3676721d73538bf3bd37942bc17fcc2"}
Jul 28 22:40:03.219302 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:03.218949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6" event={"ID":"1b6804b3-b204-44e3-976f-453bdc04b64c","Type":"ContainerStarted","Data":"419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919"}
Jul 28 22:40:03.234086 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:03.234034    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6" podStartSLOduration=1.234017737 podStartE2EDuration="1.234017737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:40:03.232621703 +0000 UTC m=+2130.544860733" watchObservedRunningTime="2026-07-28 22:40:03.234017737 +0000 UTC m=+2130.546256728"
Jul 28 22:40:04.226411 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:04.226372    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b6804b3-b204-44e3-976f-453bdc04b64c" containerID="17d65f4e3825524a8e2443dfd30ee959c3676721d73538bf3bd37942bc17fcc2" exitCode=0
Jul 28 22:40:04.226810 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:04.226417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6" event={"ID":"1b6804b3-b204-44e3-976f-453bdc04b64c","Type":"ContainerDied","Data":"17d65f4e3825524a8e2443dfd30ee959c3676721d73538bf3bd37942bc17fcc2"}
Jul 28 22:40:05.166138 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:05.166088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:05.367369 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:05.367345    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:05.469464 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:05.469431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca\") pod \"1b6804b3-b204-44e3-976f-453bdc04b64c\" (UID: \"1b6804b3-b204-44e3-976f-453bdc04b64c\") "
Jul 28 22:40:05.469824 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:05.469801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b6804b3-b204-44e3-976f-453bdc04b64c" (UID: "1b6804b3-b204-44e3-976f-453bdc04b64c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:40:05.570238 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:05.570196    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6804b3-b204-44e3-976f-453bdc04b64c-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:40:06.239361 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:06.239320    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"
Jul 28 22:40:06.239361 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:06.239345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6" event={"ID":"1b6804b3-b204-44e3-976f-453bdc04b64c","Type":"ContainerDied","Data":"419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919"}
Jul 28 22:40:06.239575 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:06.239389    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="419de5550df6f7bb5cf53819fee51a8c8598993bb3aa9700d9bbe949ec32e919"
Jul 28 22:40:12.895674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:12.895629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:12.960841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:12.960801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:13.057701 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.057667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:13.064009 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.063982    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"]
Jul 28 22:40:13.066265 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.066244    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cc3d4e93-cgfj6"]
Jul 28 22:40:13.113267 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.113234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:13.246024 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.245988    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b6804b3-b204-44e3-976f-453bdc04b64c" path="/var/lib/kubelet/pods/1b6804b3-b204-44e3-976f-453bdc04b64c/volumes"
Jul 28 22:40:13.437703 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:13.437673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.272471 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.272427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.331859 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.331822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.537004 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.536919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.761683 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.761651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.907619 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.907490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:19.994765 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:19.994725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:20.117922 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:20.117889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:25.970888 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:25.970784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:26.074508 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:26.074472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:26.171092 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:26.171049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:26.336294 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:26.336205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:32.468097 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:32.468052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:32.524497 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:32.524459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:39.430962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:39.430918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:39.734868 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:39.734771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:39.834459 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:39.834429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:42.559954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:42.559911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:42.643254 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:42.643216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:42.717740 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:42.717696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:42.996351 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:42.996312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:43.343293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:43.343203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:40:43.443596 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:40:43.443547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:06.512531 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:06.512493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:06.564164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:06.564126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:07.579611 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:07.579544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:20.263434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:20.263394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:37.329110 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:37.329070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:42.014360 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.014319    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"]
Jul 28 22:41:42.014869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.014750    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b6804b3-b204-44e3-976f-453bdc04b64c" containerName="revoke-keys"
Jul 28 22:41:42.014869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.014763    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b6804b3-b204-44e3-976f-453bdc04b64c" containerName="revoke-keys"
Jul 28 22:41:42.014869 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.014852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b6804b3-b204-44e3-976f-453bdc04b64c" containerName="revoke-keys"
Jul 28 22:41:42.017931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.017916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:42.020819 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.020794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:41:42.020947 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.020807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:41:42.027554 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.027525    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"]
Jul 28 22:41:42.126929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.126883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25c13375-jdqq7\" (UID: \"eae18688-7da1-4aa7-b401-20f7ae283625\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:42.227980 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.227935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25c13375-jdqq7\" (UID: \"eae18688-7da1-4aa7-b401-20f7ae283625\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:42.228554 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.228534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25c13375-jdqq7\" (UID: \"eae18688-7da1-4aa7-b401-20f7ae283625\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:42.329742 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.329646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:42.469562 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.469534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"]
Jul 28 22:41:42.472021 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:41:42.471992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae18688_7da1_4aa7_b401_20f7ae283625.slice/crio-765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6 WatchSource:0}: Error finding container 765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6: Status 404 returned error can't find the container with id 765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6
Jul 28 22:41:42.782754 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:42.782717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7" event={"ID":"eae18688-7da1-4aa7-b401-20f7ae283625","Type":"ContainerStarted","Data":"765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6"}
Jul 28 22:41:43.790845 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:43.790808    2563 generic.go:356] "Generic (PLEG): container finished" podID="eae18688-7da1-4aa7-b401-20f7ae283625" containerID="aa8b92ddc9713e487f74eac999d246066fcbcb9194525ce6f97e37ba9a869865" exitCode=0
Jul 28 22:41:43.791248 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:43.790895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7" event={"ID":"eae18688-7da1-4aa7-b401-20f7ae283625","Type":"ContainerDied","Data":"aa8b92ddc9713e487f74eac999d246066fcbcb9194525ce6f97e37ba9a869865"}
Jul 28 22:41:44.928030 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:44.928006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:45.051423 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.051339    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca\") pod \"eae18688-7da1-4aa7-b401-20f7ae283625\" (UID: \"eae18688-7da1-4aa7-b401-20f7ae283625\") "
Jul 28 22:41:45.051747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.051723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eae18688-7da1-4aa7-b401-20f7ae283625" (UID: "eae18688-7da1-4aa7-b401-20f7ae283625"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:41:45.152757 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.152724    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eae18688-7da1-4aa7-b401-20f7ae283625-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:41:45.803725 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.803691    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"
Jul 28 22:41:45.803907 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.803723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7" event={"ID":"eae18688-7da1-4aa7-b401-20f7ae283625","Type":"ContainerDied","Data":"765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6"}
Jul 28 22:41:45.803907 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:45.803773    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765e3c24e77f7ec85f3b1cae728ebd08388c045efcc282d1bb48efeb93a378e6"
Jul 28 22:41:57.541202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.541117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:57.600047 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.600006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:57.674746 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.674705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:57.696643 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.696608    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"]
Jul 28 22:41:57.698935 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.698907    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25c13375-jdqq7"]
Jul 28 22:41:57.727613 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:57.727568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:41:59.244383 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:41:59.244349    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae18688-7da1-4aa7-b401-20f7ae283625" path="/var/lib/kubelet/pods/eae18688-7da1-4aa7-b401-20f7ae283625/volumes"
Jul 28 22:42:00.925604 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:00.925546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:42:05.972293 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:05.972257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:42:40.161217 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:40.161184    2563 scope.go:117] "RemoveContainer" containerID="a612e211d8c1df1f46062949bf1090e264facc11b8e4327ad434019f026dcbbd"
Jul 28 22:42:42.198367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:42.198332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:42:42.920005 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:42.919954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:42:48.532983 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:42:48.532938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:02.878239 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:02.878195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:02.943687 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:02.943636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:03.186028 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:03.185986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:03.472448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:03.472353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:04.535794 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:04.535760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:04.636572 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:04.636534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:05.421700 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:05.421669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:05.517312 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:05.517265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:05.617128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:05.617094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:07.088618 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:07.088554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:12.676132 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:12.676092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:12.776313 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:12.776285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:13.357411 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:13.357373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:19.155965 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:19.155920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:19.260968 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:19.260930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:19.360170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:19.360139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:29.861898 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:29.861806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:30.206553 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:30.206515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:40.183874 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:40.183841    2563 scope.go:117] "RemoveContainer" containerID="0d0311ad41e5b6ff37214543dadf961c755c806d3687e7edbcf8ce25971717b9"
Jul 28 22:43:51.190630 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:51.190570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:57.514148 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:57.514108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:57.576285 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:57.576250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:57.890687 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:57.890573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:58.208469 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:58.208424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:43:58.558458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:43:58.558368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:01.542101 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:01.542061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:01.622222 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:01.622179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:01.684516 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:01.684473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:02.101977 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:02.101940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:02.297480 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:02.297436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:02.403217 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:02.403128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:26.551870 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:26.551828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:26.890737 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:26.890642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:27.201117 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:27.201081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:28.100949 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:28.100902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:29.673157 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:29.673121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:29.777246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:29.777205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:29.932458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:29.932425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:30.157704 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.157663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:30.446177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.446143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:30.550958 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.550917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:30.553073 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.553052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:44:30.553490 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.553476    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae18688-7da1-4aa7-b401-20f7ae283625" containerName="revoke-keys"
Jul 28 22:44:30.553536 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.553491    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae18688-7da1-4aa7-b401-20f7ae283625" containerName="revoke-keys"
Jul 28 22:44:30.553576 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.553564    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae18688-7da1-4aa7-b401-20f7ae283625" containerName="revoke-keys"
Jul 28 22:44:30.556853 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.556836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.559817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.559787    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-dd9c88\""
Jul 28 22:44:30.559817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.559802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-dd9c88-dockercfg-f97rg\""
Jul 28 22:44:30.565038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.565017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:44:30.696889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.696790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.696889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.696832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhb42\" (UniqueName: \"kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.797954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.797914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.797954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.797953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhb42\" (UniqueName: \"kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.798634 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.798615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.809383 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.809355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhb42\" (UniqueName: \"kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42\") pod \"payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.868306 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.868268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:30.999858 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:30.999834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:44:31.001235 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:44:31.001211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbad8b74_c0b2_4479_806a_9471a77693cc.slice/crio-93d08357543c5375fbac45c68ae261fa124582c4939a13802c13754f55202ac9 WatchSource:0}: Error finding container 93d08357543c5375fbac45c68ae261fa124582c4939a13802c13754f55202ac9: Status 404 returned error can't find the container with id 93d08357543c5375fbac45c68ae261fa124582c4939a13802c13754f55202ac9
Jul 28 22:44:31.731227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:31.731174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" event={"ID":"cbad8b74-c0b2-4479-806a-9471a77693cc","Type":"ContainerStarted","Data":"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"}
Jul 28 22:44:31.731823 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:31.731545    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:31.731823 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:31.731614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" event={"ID":"cbad8b74-c0b2-4479-806a-9471a77693cc","Type":"ContainerStarted","Data":"93d08357543c5375fbac45c68ae261fa124582c4939a13802c13754f55202ac9"}
Jul 28 22:44:31.747456 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:31.747400    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" podStartSLOduration=1.747385247 podStartE2EDuration="1.747385247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:44:31.746969106 +0000 UTC m=+2399.059208098" watchObservedRunningTime="2026-07-28 22:44:31.747385247 +0000 UTC m=+2399.059624237"
Jul 28 22:44:33.408537 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:33.408508    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:44:33.420111 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:33.420087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:44:42.739993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:42.739960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:44:43.574260 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:43.574221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:44.834481 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:44.834445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:44:54.730745 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:44:54.730706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:45:00.136678 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.136596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"]
Jul 28 22:45:00.140225 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.140208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"
Jul 28 22:45:00.144435 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.144404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:45:00.146167 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.146134    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"]
Jul 28 22:45:00.150068 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.150046    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"]
Jul 28 22:45:00.150199 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.150176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"
Jul 28 22:45:00.152530 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.152501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"
Jul 28 22:45:00.159567 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.159545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"]
Jul 28 22:45:00.159769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.159752    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"]
Jul 28 22:45:00.160058 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.160043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"
Jul 28 22:45:00.173201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.173170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"]
Jul 28 22:45:00.193047 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.193021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"
Jul 28 22:45:00.200447 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.200424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"
Jul 28 22:45:00.332848 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.332816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"]
Jul 28 22:45:00.333640 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:45:00.333605    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fcbd47_05b9_4238_a750_e08a41e74c12.slice/crio-64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131 WatchSource:0}: Error finding container 64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131: Status 404 returned error can't find the container with id 64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131
Jul 28 22:45:00.395858 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.395832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"]
Jul 28 22:45:00.398223 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:45:00.398195    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60c3863_d0ab_4277_9607_6599ae898c9c.slice/crio-acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915 WatchSource:0}: Error finding container acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915: Status 404 returned error can't find the container with id acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915
Jul 28 22:45:00.575709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.575684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"]
Jul 28 22:45:00.577530 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:45:00.577502    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad71f50_b30c_4180_9f03_12e5e6486df0.slice/crio-f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71 WatchSource:0}: Error finding container f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71: Status 404 returned error can't find the container with id f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71
Jul 28 22:45:00.910051 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.910018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89" event={"ID":"a60c3863-d0ab-4277-9607-6599ae898c9c","Type":"ContainerStarted","Data":"a49f2d03eb2e85573620446dfb6b6489356ed1d70f124146d6dd9a63dfb16e89"}
Jul 28 22:45:00.910210 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.910079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89" event={"ID":"a60c3863-d0ab-4277-9607-6599ae898c9c","Type":"ContainerStarted","Data":"acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915"}
Jul 28 22:45:00.911543 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.911513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf" event={"ID":"f8fcbd47-05b9-4238-a750-e08a41e74c12","Type":"ContainerStarted","Data":"f4d1933f781190c5b0c6db06fabc4dcd5dfa8b7a088da2db7cb89bc7e6fea6dc"}
Jul 28 22:45:00.911661 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.911567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf" event={"ID":"f8fcbd47-05b9-4238-a750-e08a41e74c12","Type":"ContainerStarted","Data":"64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131"}
Jul 28 22:45:00.913080 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.913056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv" event={"ID":"4ad71f50-b30c-4180-9f03-12e5e6486df0","Type":"ContainerStarted","Data":"7407a0cf3e982c51c44b511bf23f6c40c958915dffb21b11b0cf75201b1c97cc"}
Jul 28 22:45:00.913197 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.913104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv" event={"ID":"4ad71f50-b30c-4180-9f03-12e5e6486df0","Type":"ContainerStarted","Data":"f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71"}
Jul 28 22:45:00.925859 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.925813    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89" podStartSLOduration=0.925797827 podStartE2EDuration="925.797827ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:45:00.923031514 +0000 UTC m=+2428.235270506" watchObservedRunningTime="2026-07-28 22:45:00.925797827 +0000 UTC m=+2428.238036889"
Jul 28 22:45:00.936800 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.936761    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf" podStartSLOduration=0.936746271 podStartE2EDuration="936.746271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:45:00.936005501 +0000 UTC m=+2428.248244487" watchObservedRunningTime="2026-07-28 22:45:00.936746271 +0000 UTC m=+2428.248985262"
Jul 28 22:45:00.950448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:00.950356    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv" podStartSLOduration=0.95033841 podStartE2EDuration="950.33841ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:45:00.948858366 +0000 UTC m=+2428.261097353" watchObservedRunningTime="2026-07-28 22:45:00.95033841 +0000 UTC m=+2428.262577402"
Jul 28 22:45:01.920475 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.920387    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8fcbd47-05b9-4238-a750-e08a41e74c12" containerID="f4d1933f781190c5b0c6db06fabc4dcd5dfa8b7a088da2db7cb89bc7e6fea6dc" exitCode=0
Jul 28 22:45:01.920900 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.920467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf" event={"ID":"f8fcbd47-05b9-4238-a750-e08a41e74c12","Type":"ContainerDied","Data":"f4d1933f781190c5b0c6db06fabc4dcd5dfa8b7a088da2db7cb89bc7e6fea6dc"}
Jul 28 22:45:01.921922 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.921895    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ad71f50-b30c-4180-9f03-12e5e6486df0" containerID="7407a0cf3e982c51c44b511bf23f6c40c958915dffb21b11b0cf75201b1c97cc" exitCode=0
Jul 28 22:45:01.922041 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.921964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv" event={"ID":"4ad71f50-b30c-4180-9f03-12e5e6486df0","Type":"ContainerDied","Data":"7407a0cf3e982c51c44b511bf23f6c40c958915dffb21b11b0cf75201b1c97cc"}
Jul 28 22:45:01.923457 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.923439    2563 generic.go:356] "Generic (PLEG): container finished" podID="a60c3863-d0ab-4277-9607-6599ae898c9c" containerID="a49f2d03eb2e85573620446dfb6b6489356ed1d70f124146d6dd9a63dfb16e89" exitCode=0
Jul 28 22:45:01.923548 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:01.923493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89" event={"ID":"a60c3863-d0ab-4277-9607-6599ae898c9c","Type":"ContainerDied","Data":"a49f2d03eb2e85573620446dfb6b6489356ed1d70f124146d6dd9a63dfb16e89"}
Jul 28 22:45:03.101081 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.101057    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"
Jul 28 22:45:03.105131 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.105109    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"
Jul 28 22:45:03.108630 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.108611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"
Jul 28 22:45:03.935846 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.935804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89" event={"ID":"a60c3863-d0ab-4277-9607-6599ae898c9c","Type":"ContainerDied","Data":"acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915"}
Jul 28 22:45:03.936041 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.935872    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acc74b66fa7d5db1203204655476bb2e1c1456307e7125a3f58395af295cb915"
Jul 28 22:45:03.936041 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.935813    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"
Jul 28 22:45:03.937163 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.937140    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"
Jul 28 22:45:03.937295 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.937164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf" event={"ID":"f8fcbd47-05b9-4238-a750-e08a41e74c12","Type":"ContainerDied","Data":"64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131"}
Jul 28 22:45:03.937295 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.937206    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64d91b7cd6e19f08a11e3ab6ac321b7374b802a7dad2ad15fe183a2c03d30131"
Jul 28 22:45:03.938697 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.938679    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv"
Jul 28 22:45:03.938816 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.938680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754645-6x6cv" event={"ID":"4ad71f50-b30c-4180-9f03-12e5e6486df0","Type":"ContainerDied","Data":"f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71"}
Jul 28 22:45:03.938816 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:03.938788    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f091b9c0a1545f9c4b28efc98e5f866271cca8998aea4c4ab03333b1b4be1c71"
Jul 28 22:45:07.191953 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:07.191910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:45:39.930367 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:39.930325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:45:49.598975 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:45:49.598934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:01.403202 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:01.403159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:19.700980 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:19.700949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:20.597931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.597892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:20.733400 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733365    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"]
Jul 28 22:46:20.733774 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733759    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60c3863-d0ab-4277-9607-6599ae898c9c" containerName="cleanup"
Jul 28 22:46:20.733774 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60c3863-d0ab-4277-9607-6599ae898c9c" containerName="cleanup"
Jul 28 22:46:20.733855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733795    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8fcbd47-05b9-4238-a750-e08a41e74c12" containerName="cleanup"
Jul 28 22:46:20.733855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733801    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8fcbd47-05b9-4238-a750-e08a41e74c12" containerName="cleanup"
Jul 28 22:46:20.733855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733811    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad71f50-b30c-4180-9f03-12e5e6486df0" containerName="cleanup"
Jul 28 22:46:20.733855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733817    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad71f50-b30c-4180-9f03-12e5e6486df0" containerName="cleanup"
Jul 28 22:46:20.733977 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733879    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad71f50-b30c-4180-9f03-12e5e6486df0" containerName="cleanup"
Jul 28 22:46:20.733977 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733886    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60c3863-d0ab-4277-9607-6599ae898c9c" containerName="cleanup"
Jul 28 22:46:20.733977 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.733893    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8fcbd47-05b9-4238-a750-e08a41e74c12" containerName="cleanup"
Jul 28 22:46:20.736905 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.736888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:20.739683 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.739659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:46:20.739828 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.739732    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:46:20.744956 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.744900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"]
Jul 28 22:46:20.920118 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:20.920029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g\" (UID: \"8934d505-9008-4b1c-8565-dde704e0fcd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:21.021336 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:21.021301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g\" (UID: \"8934d505-9008-4b1c-8565-dde704e0fcd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:21.022015 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:21.021994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g\" (UID: \"8934d505-9008-4b1c-8565-dde704e0fcd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:21.050336 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:21.050311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:21.184868 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:21.184837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"]
Jul 28 22:46:21.186451 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:46:21.186427    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8934d505_9008_4b1c_8565_dde704e0fcd9.slice/crio-b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738 WatchSource:0}: Error finding container b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738: Status 404 returned error can't find the container with id b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738
Jul 28 22:46:21.383624 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:21.383590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g" event={"ID":"8934d505-9008-4b1c-8565-dde704e0fcd9","Type":"ContainerStarted","Data":"b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738"}
Jul 28 22:46:22.391192 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:22.391156    2563 generic.go:356] "Generic (PLEG): container finished" podID="8934d505-9008-4b1c-8565-dde704e0fcd9" containerID="f328c486c7e861ad2f2e1427166ee7d59ef759afd5b56a0a6d7bb4ab147f116f" exitCode=0
Jul 28 22:46:22.391705 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:22.391226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g" event={"ID":"8934d505-9008-4b1c-8565-dde704e0fcd9","Type":"ContainerDied","Data":"f328c486c7e861ad2f2e1427166ee7d59ef759afd5b56a0a6d7bb4ab147f116f"}
Jul 28 22:46:23.528159 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:23.528131    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:23.542362 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:23.542334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca\") pod \"8934d505-9008-4b1c-8565-dde704e0fcd9\" (UID: \"8934d505-9008-4b1c-8565-dde704e0fcd9\") "
Jul 28 22:46:23.542706 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:23.542682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8934d505-9008-4b1c-8565-dde704e0fcd9" (UID: "8934d505-9008-4b1c-8565-dde704e0fcd9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:46:23.643136 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:23.643104    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8934d505-9008-4b1c-8565-dde704e0fcd9-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:46:24.403526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:24.403490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g" event={"ID":"8934d505-9008-4b1c-8565-dde704e0fcd9","Type":"ContainerDied","Data":"b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738"}
Jul 28 22:46:24.403526 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:24.403511    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"
Jul 28 22:46:24.403770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:24.403541    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1077e39490fe8192734918b557d29f991aec907021c573f5608c8baeb1dd738"
Jul 28 22:46:31.147100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.147021    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"]
Jul 28 22:46:31.151942 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.151911    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9216b7-29754645-cvl89"]
Jul 28 22:46:31.153072 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.153040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:31.214771 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.214739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:31.244915 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.244886    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a60c3863-d0ab-4277-9607-6599ae898c9c" path="/var/lib/kubelet/pods/a60c3863-d0ab-4277-9607-6599ae898c9c/volumes"
Jul 28 22:46:31.273616 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.273557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:31.323987 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.323956    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"]
Jul 28 22:46:31.326522 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.326495    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9216b7-5js4g"]
Jul 28 22:46:31.329255 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.329230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:31.696822 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:31.696784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:33.245402 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:33.245368    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8934d505-9008-4b1c-8565-dde704e0fcd9" path="/var/lib/kubelet/pods/8934d505-9008-4b1c-8565-dde704e0fcd9/volumes"
Jul 28 22:46:37.460054 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:37.460012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:37.534884 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:37.534846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:37.742909 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:37.742818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:37.963146 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:37.963098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:38.083360 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.083271    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"]
Jul 28 22:46:38.083810 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.083789    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8934d505-9008-4b1c-8565-dde704e0fcd9" containerName="revoke-keys"
Jul 28 22:46:38.083914 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.083811    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8934d505-9008-4b1c-8565-dde704e0fcd9" containerName="revoke-keys"
Jul 28 22:46:38.083973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.083913    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8934d505-9008-4b1c-8565-dde704e0fcd9" containerName="revoke-keys"
Jul 28 22:46:38.088229 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.088206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:38.091219 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.091190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:46:38.092613 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.092563    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:46:38.095872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.095851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"]
Jul 28 22:46:38.177719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.177674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9\" (UID: \"33a6fac8-9232-4fd2-8649-7fcd6cf56404\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:38.278782 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.278553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9\" (UID: \"33a6fac8-9232-4fd2-8649-7fcd6cf56404\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:38.279277 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.279254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9\" (UID: \"33a6fac8-9232-4fd2-8649-7fcd6cf56404\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:38.400442 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.400351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:38.538331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:38.538301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"]
Jul 28 22:46:38.539867 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:46:38.539840    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a6fac8_9232_4fd2_8649_7fcd6cf56404.slice/crio-53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f WatchSource:0}: Error finding container 53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f: Status 404 returned error can't find the container with id 53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f
Jul 28 22:46:39.493178 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:39.493076    2563 generic.go:356] "Generic (PLEG): container finished" podID="33a6fac8-9232-4fd2-8649-7fcd6cf56404" containerID="20f28d3140581cc78a0d065c17b670b72bd81fe406a5435109393c35d8991856" exitCode=0
Jul 28 22:46:39.493331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:39.493164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9" event={"ID":"33a6fac8-9232-4fd2-8649-7fcd6cf56404","Type":"ContainerDied","Data":"20f28d3140581cc78a0d065c17b670b72bd81fe406a5435109393c35d8991856"}
Jul 28 22:46:39.493331 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:39.493242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9" event={"ID":"33a6fac8-9232-4fd2-8649-7fcd6cf56404","Type":"ContainerStarted","Data":"53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f"}
Jul 28 22:46:40.159405 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.159363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:40.225559 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.225520    2563 scope.go:117] "RemoveContainer" containerID="17d65f4e3825524a8e2443dfd30ee959c3676721d73538bf3bd37942bc17fcc2"
Jul 28 22:46:40.630732 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.630705    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:40.701444 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.701414    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca\") pod \"33a6fac8-9232-4fd2-8649-7fcd6cf56404\" (UID: \"33a6fac8-9232-4fd2-8649-7fcd6cf56404\") "
Jul 28 22:46:40.701811 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.701791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33a6fac8-9232-4fd2-8649-7fcd6cf56404" (UID: "33a6fac8-9232-4fd2-8649-7fcd6cf56404"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:46:40.802675 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:40.802569    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a6fac8-9232-4fd2-8649-7fcd6cf56404-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:46:41.506125 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:41.506049    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"
Jul 28 22:46:41.506529 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:41.506045    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9" event={"ID":"33a6fac8-9232-4fd2-8649-7fcd6cf56404","Type":"ContainerDied","Data":"53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f"}
Jul 28 22:46:41.506529 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:41.506176    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53396ba31bb1c57acd626a702b5d9a983c710a7fa6bfc6d6c60ebb2411b9740f"
Jul 28 22:46:48.531352 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.531308    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"]
Jul 28 22:46:48.532540 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.532504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:48.534351 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.534329    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd9c88-29754645-kggwf"]
Jul 28 22:46:48.567205 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.567172    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:46:48.567458 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.567432    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" podUID="cbad8b74-c0b2-4479-806a-9471a77693cc" containerName="payload-pre-processing" containerID="cri-o://c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe" gracePeriod=30
Jul 28 22:46:48.632291 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.632255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:48.700237 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.700202    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"]
Jul 28 22:46:48.702334 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.702302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:48.703070 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.703043    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-dd9c88-95cf9"]
Jul 28 22:46:48.755436 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.755406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:48.841735 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.841711    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:46:48.974204 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.974172    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume\") pod \"cbad8b74-c0b2-4479-806a-9471a77693cc\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") "
Jul 28 22:46:48.974470 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.974218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhb42\" (UniqueName: \"kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42\") pod \"cbad8b74-c0b2-4479-806a-9471a77693cc\" (UID: \"cbad8b74-c0b2-4479-806a-9471a77693cc\") "
Jul 28 22:46:48.974630 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.974604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbad8b74-c0b2-4479-806a-9471a77693cc" (UID: "cbad8b74-c0b2-4479-806a-9471a77693cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:46:48.976544 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:48.976517    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42" (OuterVolumeSpecName: "kube-api-access-hhb42") pod "cbad8b74-c0b2-4479-806a-9471a77693cc" (UID: "cbad8b74-c0b2-4479-806a-9471a77693cc"). InnerVolumeSpecName "kube-api-access-hhb42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:46:49.075344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.075252    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbad8b74-c0b2-4479-806a-9471a77693cc-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:46:49.075344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.075287    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhb42\" (UniqueName: \"kubernetes.io/projected/cbad8b74-c0b2-4479-806a-9471a77693cc-kube-api-access-hhb42\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:46:49.081433 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.081398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:49.248318 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.248285    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a6fac8-9232-4fd2-8649-7fcd6cf56404" path="/var/lib/kubelet/pods/33a6fac8-9232-4fd2-8649-7fcd6cf56404/volumes"
Jul 28 22:46:49.248593 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.248569    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8fcbd47-05b9-4238-a750-e08a41e74c12" path="/var/lib/kubelet/pods/f8fcbd47-05b9-4238-a750-e08a41e74c12/volumes"
Jul 28 22:46:49.553073 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.553042    2563 generic.go:356] "Generic (PLEG): container finished" podID="cbad8b74-c0b2-4479-806a-9471a77693cc" containerID="c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe" exitCode=0
Jul 28 22:46:49.553595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.553083    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"
Jul 28 22:46:49.553595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.553126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" event={"ID":"cbad8b74-c0b2-4479-806a-9471a77693cc","Type":"ContainerDied","Data":"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"}
Jul 28 22:46:49.553595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.553178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h" event={"ID":"cbad8b74-c0b2-4479-806a-9471a77693cc","Type":"ContainerDied","Data":"93d08357543c5375fbac45c68ae261fa124582c4939a13802c13754f55202ac9"}
Jul 28 22:46:49.553595 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.553204    2563 scope.go:117] "RemoveContainer" containerID="c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"
Jul 28 22:46:49.563011 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.562991    2563 scope.go:117] "RemoveContainer" containerID="c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"
Jul 28 22:46:49.563282 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:46:49.563261    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe\": container with ID starting with c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe not found: ID does not exist" containerID="c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"
Jul 28 22:46:49.563338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.563291    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe"} err="failed to get container status \"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe\": rpc error: code = NotFound desc = could not find container \"c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe\": container with ID starting with c71e204b2da5f00c4f28915e91a2ae69cea94c9199dfb4b37a488f34564c5abe not found: ID does not exist"
Jul 28 22:46:49.572431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.572405    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:46:49.577012 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:49.576992    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-dd9c88-74cc7d6f48-bj68h"]
Jul 28 22:46:51.244454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:51.244420    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbad8b74-c0b2-4479-806a-9471a77693cc" path="/var/lib/kubelet/pods/cbad8b74-c0b2-4479-806a-9471a77693cc/volumes"
Jul 28 22:46:55.219187 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:55.219149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:55.288164 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:55.288128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:55.498212 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:55.498119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:55.781365 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:55.781258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:56.157352 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:56.157266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:56.488392 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:56.488356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:56.585442 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:56.585398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:59.389304 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:59.389258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:59.493439 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:59.493403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:59.594804 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:59.594765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:46:59.779532 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:46:59.779495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:00.180719 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:00.180688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:00.279662 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:00.279632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:24.409937 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:24.409895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:24.912859 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:24.912818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:25.216994 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:25.216962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:25.594623 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:25.594514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:28.643145 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:28.643096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:28.733159 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:28.733125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:29.028163 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.028128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:29.274365 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.274326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:29.611225 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.611180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:29.716650 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.716610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:29.722360 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722330    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:47:29.722844 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722826    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a6fac8-9232-4fd2-8649-7fcd6cf56404" containerName="revoke-keys"
Jul 28 22:47:29.722901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722849    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a6fac8-9232-4fd2-8649-7fcd6cf56404" containerName="revoke-keys"
Jul 28 22:47:29.722901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722861    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbad8b74-c0b2-4479-806a-9471a77693cc" containerName="payload-pre-processing"
Jul 28 22:47:29.722901 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722867    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbad8b74-c0b2-4479-806a-9471a77693cc" containerName="payload-pre-processing"
Jul 28 22:47:29.722999 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722931    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a6fac8-9232-4fd2-8649-7fcd6cf56404" containerName="revoke-keys"
Jul 28 22:47:29.722999 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.722939    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbad8b74-c0b2-4479-806a-9471a77693cc" containerName="payload-pre-processing"
Jul 28 22:47:29.726155 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.726140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.728697 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.728676    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9bcb6e\""
Jul 28 22:47:29.728825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.728676    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9bcb6e-dockercfg-kwq4d\""
Jul 28 22:47:29.737206 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.737179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:47:29.839253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.839221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2rlr\" (UniqueName: \"kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.839409 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.839259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.940569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.940526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rlr\" (UniqueName: \"kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.940797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.940575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.941321 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.941298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:29.948804 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:29.948769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2rlr\" (UniqueName: \"kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr\") pod \"payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:30.037508 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.037471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:30.379619 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.379575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:47:30.381171 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:47:30.381144    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33a0c5a_f6f3_4cc9_ac50_00b16eb72266.slice/crio-732625e9c11711af8d06f7f08b186490f120f9e8da994230626cf932c4ea02be WatchSource:0}: Error finding container 732625e9c11711af8d06f7f08b186490f120f9e8da994230626cf932c4ea02be: Status 404 returned error can't find the container with id 732625e9c11711af8d06f7f08b186490f120f9e8da994230626cf932c4ea02be
Jul 28 22:47:30.796739 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.796707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" event={"ID":"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266","Type":"ContainerStarted","Data":"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"}
Jul 28 22:47:30.797147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.796765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:30.797147 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.796783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" event={"ID":"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266","Type":"ContainerStarted","Data":"732625e9c11711af8d06f7f08b186490f120f9e8da994230626cf932c4ea02be"}
Jul 28 22:47:30.813152 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:30.813109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" podStartSLOduration=1.8130940789999999 podStartE2EDuration="1.813094079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:47:30.812534112 +0000 UTC m=+2578.124773111" watchObservedRunningTime="2026-07-28 22:47:30.813094079 +0000 UTC m=+2578.125333070"
Jul 28 22:47:41.805243 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:41.805209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:47:53.543125 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:53.543086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:47:56.455857 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.455767    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"]
Jul 28 22:47:56.459445 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.459427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:56.462006 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.461980    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:47:56.462126 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.462021    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:47:56.467289 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.467259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"]
Jul 28 22:47:56.584935 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.584891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-26e94d-btw9m\" (UID: \"5c65f34a-c3cf-49cf-ad8a-9307c2d98924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:56.685614 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.685563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-26e94d-btw9m\" (UID: \"5c65f34a-c3cf-49cf-ad8a-9307c2d98924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:56.686201 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.686180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-26e94d-btw9m\" (UID: \"5c65f34a-c3cf-49cf-ad8a-9307c2d98924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:56.771213 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.771129    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:56.907546 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.907518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"]
Jul 28 22:47:56.908978 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:47:56.908949    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c65f34a_c3cf_49cf_ad8a_9307c2d98924.slice/crio-fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92 WatchSource:0}: Error finding container fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92: Status 404 returned error can't find the container with id fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92
Jul 28 22:47:56.956040 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:56.956012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m" event={"ID":"5c65f34a-c3cf-49cf-ad8a-9307c2d98924","Type":"ContainerStarted","Data":"fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92"}
Jul 28 22:47:57.964246 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:57.964206    2563 generic.go:356] "Generic (PLEG): container finished" podID="5c65f34a-c3cf-49cf-ad8a-9307c2d98924" containerID="4ab827affc2116c4075da7d10009f590d4f5797fb894007036f95302c5a752b6" exitCode=0
Jul 28 22:47:57.964657 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:57.964277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m" event={"ID":"5c65f34a-c3cf-49cf-ad8a-9307c2d98924","Type":"ContainerDied","Data":"4ab827affc2116c4075da7d10009f590d4f5797fb894007036f95302c5a752b6"}
Jul 28 22:47:59.103427 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.103401    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:59.208123 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.208088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca\") pod \"5c65f34a-c3cf-49cf-ad8a-9307c2d98924\" (UID: \"5c65f34a-c3cf-49cf-ad8a-9307c2d98924\") "
Jul 28 22:47:59.208469 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.208445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c65f34a-c3cf-49cf-ad8a-9307c2d98924" (UID: "5c65f34a-c3cf-49cf-ad8a-9307c2d98924"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:47:59.309506 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.309471    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65f34a-c3cf-49cf-ad8a-9307c2d98924-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:47:59.977567 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.977533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"
Jul 28 22:47:59.977769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.977565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m" event={"ID":"5c65f34a-c3cf-49cf-ad8a-9307c2d98924","Type":"ContainerDied","Data":"fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92"}
Jul 28 22:47:59.977769 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:47:59.977635    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb3f36ae8fc95ccd6d81ec9e6f57b5e399e4890c5abb71c35d4ec721d5c13e92"
Jul 28 22:48:12.069016 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.068982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:12.146483 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.146450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:12.214634 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.214570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:12.253924 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.253856    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"]
Jul 28 22:48:12.258445 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.258420    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-26e94d-btw9m"]
Jul 28 22:48:12.273501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.273475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:12.637321 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:12.637283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:13.244683 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:13.244649    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c65f34a-c3cf-49cf-ad8a-9307c2d98924" path="/var/lib/kubelet/pods/5c65f34a-c3cf-49cf-ad8a-9307c2d98924/volumes"
Jul 28 22:48:15.349806 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:15.349770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:15.449990 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:15.449944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:18.552727 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:18.552687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:18.653405 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:18.653361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:18.835993 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:18.835908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:19.057495 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.057458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:19.172987 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.172904    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"]
Jul 28 22:48:19.173340 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.173327    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c65f34a-c3cf-49cf-ad8a-9307c2d98924" containerName="revoke-keys"
Jul 28 22:48:19.173394 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.173341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c65f34a-c3cf-49cf-ad8a-9307c2d98924" containerName="revoke-keys"
Jul 28 22:48:19.173443 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.173433    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c65f34a-c3cf-49cf-ad8a-9307c2d98924" containerName="revoke-keys"
Jul 28 22:48:19.176966 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.176949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:19.180054 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.180025    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:48:19.181103 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.181076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:48:19.183930 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.183906    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"]
Jul 28 22:48:19.286279 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.286243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd\" (UID: \"f19d8482-3ecf-45dd-8777-c2ed83d5cc73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:19.387841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.387808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd\" (UID: \"f19d8482-3ecf-45dd-8777-c2ed83d5cc73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:19.388448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.388420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd\" (UID: \"f19d8482-3ecf-45dd-8777-c2ed83d5cc73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:19.489038 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.488998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:19.623109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:19.623082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"]
Jul 28 22:48:19.624424 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:48:19.624398    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19d8482_3ecf_45dd_8777_c2ed83d5cc73.slice/crio-d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1 WatchSource:0}: Error finding container d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1: Status 404 returned error can't find the container with id d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1
Jul 28 22:48:20.092388 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:20.092297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd" event={"ID":"f19d8482-3ecf-45dd-8777-c2ed83d5cc73","Type":"ContainerStarted","Data":"fa1cd893ca766e74b59d081c79e305ae116f9f90a58d77ef963a269b91ba1250"}
Jul 28 22:48:20.092388 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:20.092364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd" event={"ID":"f19d8482-3ecf-45dd-8777-c2ed83d5cc73","Type":"ContainerStarted","Data":"d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1"}
Jul 28 22:48:20.106624 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:20.106476    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd" podStartSLOduration=1.106458636 podStartE2EDuration="1.106458636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:48:20.10624916 +0000 UTC m=+2627.418488153" watchObservedRunningTime="2026-07-28 22:48:20.106458636 +0000 UTC m=+2627.418697631"
Jul 28 22:48:21.099733 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:21.099695    2563 generic.go:356] "Generic (PLEG): container finished" podID="f19d8482-3ecf-45dd-8777-c2ed83d5cc73" containerID="fa1cd893ca766e74b59d081c79e305ae116f9f90a58d77ef963a269b91ba1250" exitCode=0
Jul 28 22:48:21.100194 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:21.099779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd" event={"ID":"f19d8482-3ecf-45dd-8777-c2ed83d5cc73","Type":"ContainerDied","Data":"fa1cd893ca766e74b59d081c79e305ae116f9f90a58d77ef963a269b91ba1250"}
Jul 28 22:48:22.247359 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:22.247334    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:22.317050 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:22.317013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca\") pod \"f19d8482-3ecf-45dd-8777-c2ed83d5cc73\" (UID: \"f19d8482-3ecf-45dd-8777-c2ed83d5cc73\") "
Jul 28 22:48:22.317377 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:22.317348    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f19d8482-3ecf-45dd-8777-c2ed83d5cc73" (UID: "f19d8482-3ecf-45dd-8777-c2ed83d5cc73"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:48:22.418558 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:22.418477    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f19d8482-3ecf-45dd-8777-c2ed83d5cc73-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:48:23.111942 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:23.111907    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"
Jul 28 22:48:23.112122 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:23.111941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd" event={"ID":"f19d8482-3ecf-45dd-8777-c2ed83d5cc73","Type":"ContainerDied","Data":"d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1"}
Jul 28 22:48:23.112122 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:23.112016    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4f8f3f8a5e588adfcffeaaaf32b75d631764e32c4c85970d5e9eb79ae6783a1"
Jul 28 22:48:34.705072 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.705039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:34.740048 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.740014    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:48:34.740339 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.740287    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" podUID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" containerName="payload-pre-processing" containerID="cri-o://337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992" gracePeriod=30
Jul 28 22:48:34.805615 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.805559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:34.868887 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.868857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:34.869790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.869772    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"]
Jul 28 22:48:34.872602 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.872533    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9bcb6e-kvdxd"]
Jul 28 22:48:34.925957 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.925930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:34.998804 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:34.998779    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:48:35.141216 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.141178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume\") pod \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") "
Jul 28 22:48:35.141424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.141290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2rlr\" (UniqueName: \"kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr\") pod \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\" (UID: \"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266\") "
Jul 28 22:48:35.141594 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.141560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" (UID: "e33a0c5a-f6f3-4cc9-ac50-00b16eb72266"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:48:35.143420 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.143399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr" (OuterVolumeSpecName: "kube-api-access-g2rlr") pod "e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" (UID: "e33a0c5a-f6f3-4cc9-ac50-00b16eb72266"). InnerVolumeSpecName "kube-api-access-g2rlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:48:35.184959 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.184926    2563 generic.go:356] "Generic (PLEG): container finished" podID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" containerID="337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992" exitCode=0
Jul 28 22:48:35.185166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.184981    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"
Jul 28 22:48:35.185166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.185018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" event={"ID":"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266","Type":"ContainerDied","Data":"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"}
Jul 28 22:48:35.185166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.185077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76" event={"ID":"e33a0c5a-f6f3-4cc9-ac50-00b16eb72266","Type":"ContainerDied","Data":"732625e9c11711af8d06f7f08b186490f120f9e8da994230626cf932c4ea02be"}
Jul 28 22:48:35.185166 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.185102    2563 scope.go:117] "RemoveContainer" containerID="337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"
Jul 28 22:48:35.195226 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.195205    2563 scope.go:117] "RemoveContainer" containerID="337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"
Jul 28 22:48:35.195473 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:48:35.195456    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992\": container with ID starting with 337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992 not found: ID does not exist" containerID="337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"
Jul 28 22:48:35.195524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.195480    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992"} err="failed to get container status \"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992\": rpc error: code = NotFound desc = could not find container \"337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992\": container with ID starting with 337dd3ccb913dcccd9ab6de13bd2ecd895e79c673a0cb62e1f22ba6a76c53992 not found: ID does not exist"
Jul 28 22:48:35.207847 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.207814    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:48:35.211908 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.211880    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9bcb6e-595bc9998d-lfk76"]
Jul 28 22:48:35.242189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.242108    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2rlr\" (UniqueName: \"kubernetes.io/projected/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-kube-api-access-g2rlr\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:48:35.242189 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.242143    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:48:35.244945 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.244919    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" path="/var/lib/kubelet/pods/e33a0c5a-f6f3-4cc9-ac50-00b16eb72266/volumes"
Jul 28 22:48:35.245254 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.245240    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19d8482-3ecf-45dd-8777-c2ed83d5cc73" path="/var/lib/kubelet/pods/f19d8482-3ecf-45dd-8777-c2ed83d5cc73/volumes"
Jul 28 22:48:35.258962 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:35.258923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:40.262904 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:40.262872    2563 scope.go:117] "RemoveContainer" containerID="aa8b92ddc9713e487f74eac999d246066fcbcb9194525ce6f97e37ba9a869865"
Jul 28 22:48:40.933244 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:40.933213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:41.033793 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:41.033754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:41.193399 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:41.193294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:41.421120 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:41.421085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:41.772889 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:41.772842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:42.092179 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:42.092096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:42.191710 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:42.191679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:44.877988 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:44.877952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:44.975043 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:44.974998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:45.049365 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:45.049331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:45.261406 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:45.261354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:45.749282 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:45.749253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:48:45.855191 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:48:45.855155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:09.873019 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:09.872982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:10.202426 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:10.202391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:10.589809 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:10.589710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:10.984021 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:10.983983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.022537 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.022499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.111661 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.111616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.186695 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.186658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.354736 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.354637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.704190 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.704157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.808013 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.807976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:13.844042 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844010    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 22:49:13.844415 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844401    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19d8482-3ecf-45dd-8777-c2ed83d5cc73" containerName="revoke-keys"
Jul 28 22:49:13.844474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844416    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19d8482-3ecf-45dd-8777-c2ed83d5cc73" containerName="revoke-keys"
Jul 28 22:49:13.844474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844440    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" containerName="payload-pre-processing"
Jul 28 22:49:13.844474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844447    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" containerName="payload-pre-processing"
Jul 28 22:49:13.844570 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844510    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e33a0c5a-f6f3-4cc9-ac50-00b16eb72266" containerName="payload-pre-processing"
Jul 28 22:49:13.844570 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.844519    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19d8482-3ecf-45dd-8777-c2ed83d5cc73" containerName="revoke-keys"
Jul 28 22:49:13.847730 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.847713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:13.850517 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.850493    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-aa2de7\""
Jul 28 22:49:13.850663 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.850546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-aa2de7-dockercfg-dkd6c\""
Jul 28 22:49:13.858033 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:13.858004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 22:49:14.001647 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.001536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh6j\" (UniqueName: \"kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.001647 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.001607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.102672 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.102628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh6j\" (UniqueName: \"kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.103080 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.102680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.103351 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.103331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.111363 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.111338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh6j\" (UniqueName: \"kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j\") pod \"payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.159704 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.159668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:14.533283 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:14.533254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 22:49:14.534546 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:49:14.534517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5742d2b8_28d7_410e_be58_6a994432038b.slice/crio-1c5a8cd1fcbb1206632f4014b80b28ec3214736e4f8d974acaf9e574bc4e68a2 WatchSource:0}: Error finding container 1c5a8cd1fcbb1206632f4014b80b28ec3214736e4f8d974acaf9e574bc4e68a2: Status 404 returned error can't find the container with id 1c5a8cd1fcbb1206632f4014b80b28ec3214736e4f8d974acaf9e574bc4e68a2
Jul 28 22:49:15.417657 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:15.417609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" event={"ID":"5742d2b8-28d7-410e-be58-6a994432038b","Type":"ContainerStarted","Data":"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"}
Jul 28 22:49:15.418065 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:15.417680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:15.418065 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:15.417706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" event={"ID":"5742d2b8-28d7-410e-be58-6a994432038b","Type":"ContainerStarted","Data":"1c5a8cd1fcbb1206632f4014b80b28ec3214736e4f8d974acaf9e574bc4e68a2"}
Jul 28 22:49:15.434465 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:15.434412    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" podStartSLOduration=2.434395512 podStartE2EDuration="2.434395512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:49:15.432489663 +0000 UTC m=+2682.744728661" watchObservedRunningTime="2026-07-28 22:49:15.434395512 +0000 UTC m=+2682.746634503"
Jul 28 22:49:26.426232 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:26.426140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 22:49:33.448018 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:33.447988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:49:33.462215 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:33.462191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:49:35.484069 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:35.484031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:35.581723 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:35.581694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:38.023196 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:38.023151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:49:44.058374 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:49:44.058333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:50:07.114192 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:50:07.114153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:50:32.906863 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:50:32.906814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:50:33.006102 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:50:33.006064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:50:41.364491 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:50:41.364456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:50:41.464872 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:50:41.464831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:51:40.307737 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:51:40.307703    2563 scope.go:117] "RemoveContainer" containerID="a49f2d03eb2e85573620446dfb6b6489356ed1d70f124146d6dd9a63dfb16e89"
Jul 28 22:51:40.317001 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:51:40.316980    2563 scope.go:117] "RemoveContainer" containerID="f4d1933f781190c5b0c6db06fabc4dcd5dfa8b7a088da2db7cb89bc7e6fea6dc"
Jul 28 22:52:40.345046 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:52:40.345013    2563 scope.go:117] "RemoveContainer" containerID="20f28d3140581cc78a0d065c17b670b72bd81fe406a5435109393c35d8991856"
Jul 28 22:52:40.354768 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:52:40.354745    2563 scope.go:117] "RemoveContainer" containerID="f328c486c7e861ad2f2e1427166ee7d59ef759afd5b56a0a6d7bb4ab147f116f"
Jul 28 22:53:55.508790 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:53:55.508732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:53:55.662333 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:53:55.662256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:53:55.764137 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:53:55.764051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:54:31.049904 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:31.049873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:54:31.992129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:31.992091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:54:33.487818 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:33.487790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:54:33.508746 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:33.508719    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:54:38.306552 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:38.306510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:54:40.391709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:40.391671    2563 scope.go:117] "RemoveContainer" containerID="fa1cd893ca766e74b59d081c79e305ae116f9f90a58d77ef963a269b91ba1250"
Jul 28 22:54:40.401083 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:40.401064    2563 scope.go:117] "RemoveContainer" containerID="4ab827affc2116c4075da7d10009f590d4f5797fb894007036f95302c5a752b6"
Jul 28 22:54:49.546652 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:54:49.546612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:55:07.373890 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:55:07.373855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:56:16.809083 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:56:16.809047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:56:17.862591 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:56:17.862544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:56:34.790222 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:56:34.790188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:57:00.800609 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:57:00.800500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:13.512267 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:13.512224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:14.324812 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:14.324782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:15.261957 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.261925    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240979632"]
Jul 28 22:58:15.265478 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.265460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:15.268671 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.268571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wjzjn\""
Jul 28 22:58:15.270965 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.270945    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240979632"]
Jul 28 22:58:15.343116 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.343085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lvr\" (UniqueName: \"kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr\") pod \"test-curl-7545-140584240979632\" (UID: \"a347e683-c8e8-4089-8f9d-b3d3a02a1983\") " pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:15.444040 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.444008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lvr\" (UniqueName: \"kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr\") pod \"test-curl-7545-140584240979632\" (UID: \"a347e683-c8e8-4089-8f9d-b3d3a02a1983\") " pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:15.451936 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.451910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lvr\" (UniqueName: \"kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr\") pod \"test-curl-7545-140584240979632\" (UID: \"a347e683-c8e8-4089-8f9d-b3d3a02a1983\") " pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:15.576883 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.576809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:15.707707 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.707685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240979632"]
Jul 28 22:58:15.710094 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:15.710066    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda347e683_c8e8_4089_8f9d_b3d3a02a1983.slice/crio-0935a36640d87aae101a7181565ef3adb40c4bced51ecc8ad9e5f0602774a58d WatchSource:0}: Error finding container 0935a36640d87aae101a7181565ef3adb40c4bced51ecc8ad9e5f0602774a58d: Status 404 returned error can't find the container with id 0935a36640d87aae101a7181565ef3adb40c4bced51ecc8ad9e5f0602774a58d
Jul 28 22:58:15.711802 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:15.711780    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:58:16.534350 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:16.534317    2563 generic.go:356] "Generic (PLEG): container finished" podID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" containerID="f7d93f6025e0ceb5e43a73ae9ea5cc40d6389413c272d568e6cfb9ac23b710c6" exitCode=0
Jul 28 22:58:16.534713 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:16.534396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240979632" event={"ID":"a347e683-c8e8-4089-8f9d-b3d3a02a1983","Type":"ContainerDied","Data":"f7d93f6025e0ceb5e43a73ae9ea5cc40d6389413c272d568e6cfb9ac23b710c6"}
Jul 28 22:58:16.534713 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:16.534436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240979632" event={"ID":"a347e683-c8e8-4089-8f9d-b3d3a02a1983","Type":"ContainerStarted","Data":"0935a36640d87aae101a7181565ef3adb40c4bced51ecc8ad9e5f0602774a58d"}
Jul 28 22:58:17.676913 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.676886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:17.696448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.696420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240979632_a347e683-c8e8-4089-8f9d-b3d3a02a1983/test-curl-7545-140584240979632/0.log"
Jul 28 22:58:17.721407 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.721378    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240979632"]
Jul 28 22:58:17.724424 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.724386    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240979632"]
Jul 28 22:58:17.765366 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.765336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9lvr\" (UniqueName: \"kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr\") pod \"a347e683-c8e8-4089-8f9d-b3d3a02a1983\" (UID: \"a347e683-c8e8-4089-8f9d-b3d3a02a1983\") "
Jul 28 22:58:17.767557 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.767531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr" (OuterVolumeSpecName: "kube-api-access-f9lvr") pod "a347e683-c8e8-4089-8f9d-b3d3a02a1983" (UID: "a347e683-c8e8-4089-8f9d-b3d3a02a1983"). InnerVolumeSpecName "kube-api-access-f9lvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:17.850501 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.850427    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240869552"]
Jul 28 22:58:17.850859 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.850846    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" containerName="test-curl-7545-140584240979632"
Jul 28 22:58:17.850903 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.850861    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" containerName="test-curl-7545-140584240979632"
Jul 28 22:58:17.850952 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.850943    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" containerName="test-curl-7545-140584240979632"
Jul 28 22:58:17.854064 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.854048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:17.860299 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.860272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240869552"]
Jul 28 22:58:17.866674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.866636    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9lvr\" (UniqueName: \"kubernetes.io/projected/a347e683-c8e8-4089-8f9d-b3d3a02a1983-kube-api-access-f9lvr\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:17.967513 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:17.967474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwwg\" (UniqueName: \"kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg\") pod \"test-curl-7545-140584240869552\" (UID: \"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7\") " pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:18.068837 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.068803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwwg\" (UniqueName: \"kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg\") pod \"test-curl-7545-140584240869552\" (UID: \"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7\") " pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:18.076767 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.076747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwwg\" (UniqueName: \"kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg\") pod \"test-curl-7545-140584240869552\" (UID: \"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7\") " pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:18.164724 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.164642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:18.298659 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.298630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240869552"]
Jul 28 22:58:18.299842 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:18.299816    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03e6e6d8_6b2b_44df_876a_ac9f1282f4d7.slice/crio-14341194757ed7138725e22e10dafc8fc80bcada2f138a8440d7a130d74d3434 WatchSource:0}: Error finding container 14341194757ed7138725e22e10dafc8fc80bcada2f138a8440d7a130d74d3434: Status 404 returned error can't find the container with id 14341194757ed7138725e22e10dafc8fc80bcada2f138a8440d7a130d74d3434
Jul 28 22:58:18.546177 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.546141    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:18.546363 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.546157    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0935a36640d87aae101a7181565ef3adb40c4bced51ecc8ad9e5f0602774a58d"
Jul 28 22:58:18.547878 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:18.547848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240869552" event={"ID":"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7","Type":"ContainerStarted","Data":"14341194757ed7138725e22e10dafc8fc80bcada2f138a8440d7a130d74d3434"}
Jul 28 22:58:18.557409 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:58:18.557379    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7545-140584240979632\" is forbidden: User \"system:node:ip-10-0-133-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-142.ec2.internal' and this object" podUID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" pod="opendatahub/test-curl-7545-140584240979632"
Jul 28 22:58:19.244931 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:19.244899    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a347e683-c8e8-4089-8f9d-b3d3a02a1983" path="/var/lib/kubelet/pods/a347e683-c8e8-4089-8f9d-b3d3a02a1983/volumes"
Jul 28 22:58:19.555094 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:19.555011    2563 generic.go:356] "Generic (PLEG): container finished" podID="03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" containerID="4a1c7eaf3947c0d10c46a3963d26053646bafabb70910d25aa2e2d3f08650d1b" exitCode=0
Jul 28 22:58:19.555250 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:19.555099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240869552" event={"ID":"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7","Type":"ContainerDied","Data":"4a1c7eaf3947c0d10c46a3963d26053646bafabb70910d25aa2e2d3f08650d1b"}
Jul 28 22:58:20.698851 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.698822    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:20.720329 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.720304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240869552_03e6e6d8-6b2b-44df-876a-ac9f1282f4d7/test-curl-7545-140584240869552/0.log"
Jul 28 22:58:20.750413 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.750376    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240869552"]
Jul 28 22:58:20.753859 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.753832    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240869552"]
Jul 28 22:58:20.793574 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.793549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kwwg\" (UniqueName: \"kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg\") pod \"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7\" (UID: \"03e6e6d8-6b2b-44df-876a-ac9f1282f4d7\") "
Jul 28 22:58:20.795544 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.795522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg" (OuterVolumeSpecName: "kube-api-access-4kwwg") pod "03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" (UID: "03e6e6d8-6b2b-44df-876a-ac9f1282f4d7"). InnerVolumeSpecName "kube-api-access-4kwwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:20.895214 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.895136    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kwwg\" (UniqueName: \"kubernetes.io/projected/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7-kube-api-access-4kwwg\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:20.912404 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.912371    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:20.912797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.912779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" containerName="test-curl-7545-140584240869552"
Jul 28 22:58:20.912797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.912796    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" containerName="test-curl-7545-140584240869552"
Jul 28 22:58:20.912981 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.912864    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" containerName="test-curl-7545-140584240869552"
Jul 28 22:58:20.915895 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.915877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:20.922271 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.922244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:20.996109 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:20.996076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx\") pod \"test-curl-7545-140584240945168\" (UID: \"b0b81746-b144-4ed8-9522-2cd903cd7420\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:21.097615 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.097567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx\") pod \"test-curl-7545-140584240945168\" (UID: \"b0b81746-b144-4ed8-9522-2cd903cd7420\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:21.105525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.105497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx\") pod \"test-curl-7545-140584240945168\" (UID: \"b0b81746-b144-4ed8-9522-2cd903cd7420\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:21.226979 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.226942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:21.246234 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.246206    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e6e6d8-6b2b-44df-876a-ac9f1282f4d7" path="/var/lib/kubelet/pods/03e6e6d8-6b2b-44df-876a-ac9f1282f4d7/volumes"
Jul 28 22:58:21.364324 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.364293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:21.365721 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:21.365688    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0b81746_b144_4ed8_9522_2cd903cd7420.slice/crio-9cb507ace46b87aaf8c239f9c448be639e7a9ad5e7ec23eb66aa2a7e9b9777cc WatchSource:0}: Error finding container 9cb507ace46b87aaf8c239f9c448be639e7a9ad5e7ec23eb66aa2a7e9b9777cc: Status 404 returned error can't find the container with id 9cb507ace46b87aaf8c239f9c448be639e7a9ad5e7ec23eb66aa2a7e9b9777cc
Jul 28 22:58:21.567841 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.567759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240945168" event={"ID":"b0b81746-b144-4ed8-9522-2cd903cd7420","Type":"ContainerStarted","Data":"9cb507ace46b87aaf8c239f9c448be639e7a9ad5e7ec23eb66aa2a7e9b9777cc"}
Jul 28 22:58:21.569098 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.569076    2563 scope.go:117] "RemoveContainer" containerID="4a1c7eaf3947c0d10c46a3963d26053646bafabb70910d25aa2e2d3f08650d1b"
Jul 28 22:58:21.569253 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:21.569099    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240869552"
Jul 28 22:58:22.577181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:22.577147    2563 generic.go:356] "Generic (PLEG): container finished" podID="b0b81746-b144-4ed8-9522-2cd903cd7420" containerID="c5e56d16dabeff98d93c5b071938de00648c6a55f681599fc57f6dae0d65b26b" exitCode=0
Jul 28 22:58:22.577674 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:22.577233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240945168" event={"ID":"b0b81746-b144-4ed8-9522-2cd903cd7420","Type":"ContainerDied","Data":"c5e56d16dabeff98d93c5b071938de00648c6a55f681599fc57f6dae0d65b26b"}
Jul 28 22:58:23.722612 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.722566    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:23.742431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.742402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240945168_b0b81746-b144-4ed8-9522-2cd903cd7420/test-curl-7545-140584240945168/0.log"
Jul 28 22:58:23.765770 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.765737    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:23.769488 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.769466    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:23.822529 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.822502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx\") pod \"b0b81746-b144-4ed8-9522-2cd903cd7420\" (UID: \"b0b81746-b144-4ed8-9522-2cd903cd7420\") "
Jul 28 22:58:23.824524 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.824500    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx" (OuterVolumeSpecName: "kube-api-access-p6mtx") pod "b0b81746-b144-4ed8-9522-2cd903cd7420" (UID: "b0b81746-b144-4ed8-9522-2cd903cd7420"). InnerVolumeSpecName "kube-api-access-p6mtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:23.889855 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.889772    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:23.890172 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.890159    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b81746-b144-4ed8-9522-2cd903cd7420" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:23.890220 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.890174    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b81746-b144-4ed8-9522-2cd903cd7420" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:23.890266 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.890257    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b81746-b144-4ed8-9522-2cd903cd7420" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:23.893300 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.893284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:23.898744 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.898720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:23.924301 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:23.924259    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6mtx\" (UniqueName: \"kubernetes.io/projected/b0b81746-b144-4ed8-9522-2cd903cd7420-kube-api-access-p6mtx\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:24.025400 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.025360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588rw\" (UniqueName: \"kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw\") pod \"test-curl-7545-140584240945168\" (UID: \"a2aa0da8-2d45-46ce-b253-9a2cf9067174\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:24.125992 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.125953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-588rw\" (UniqueName: \"kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw\") pod \"test-curl-7545-140584240945168\" (UID: \"a2aa0da8-2d45-46ce-b253-9a2cf9067174\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:24.133494 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.133466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-588rw\" (UniqueName: \"kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw\") pod \"test-curl-7545-140584240945168\" (UID: \"a2aa0da8-2d45-46ce-b253-9a2cf9067174\") " pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:24.204470 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.204446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:24.337136 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.337110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:24.339506 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:24.339482    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2aa0da8_2d45_46ce_b253_9a2cf9067174.slice/crio-1a8470027c01cc8b3b9f7c332ee76bb87367ebd8c210d9df14800b4fd60f86f8 WatchSource:0}: Error finding container 1a8470027c01cc8b3b9f7c332ee76bb87367ebd8c210d9df14800b4fd60f86f8: Status 404 returned error can't find the container with id 1a8470027c01cc8b3b9f7c332ee76bb87367ebd8c210d9df14800b4fd60f86f8
Jul 28 22:58:24.590129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.590042    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:24.590129 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.590082    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cb507ace46b87aaf8c239f9c448be639e7a9ad5e7ec23eb66aa2a7e9b9777cc"
Jul 28 22:58:24.591326 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.591300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240945168" event={"ID":"a2aa0da8-2d45-46ce-b253-9a2cf9067174","Type":"ContainerStarted","Data":"1a8470027c01cc8b3b9f7c332ee76bb87367ebd8c210d9df14800b4fd60f86f8"}
Jul 28 22:58:24.602408 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:24.602377    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7545-140584240945168" oldPodUID="b0b81746-b144-4ed8-9522-2cd903cd7420" podUID="a2aa0da8-2d45-46ce-b253-9a2cf9067174"
Jul 28 22:58:25.249772 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:25.249739    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b81746-b144-4ed8-9522-2cd903cd7420" path="/var/lib/kubelet/pods/b0b81746-b144-4ed8-9522-2cd903cd7420/volumes"
Jul 28 22:58:25.598151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:25.598025    2563 generic.go:356] "Generic (PLEG): container finished" podID="a2aa0da8-2d45-46ce-b253-9a2cf9067174" containerID="9e19ea15e9082f4dba605241d72064c41fcc16a6a956996519adfb7220381815" exitCode=0
Jul 28 22:58:25.598151 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:25.598113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240945168" event={"ID":"a2aa0da8-2d45-46ce-b253-9a2cf9067174","Type":"ContainerDied","Data":"9e19ea15e9082f4dba605241d72064c41fcc16a6a956996519adfb7220381815"}
Jul 28 22:58:26.743715 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.743689    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:26.764873 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.764843    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240945168_a2aa0da8-2d45-46ce-b253-9a2cf9067174/test-curl-7545-140584240945168/0.log"
Jul 28 22:58:26.790434 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.790402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:26.793175 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.793153    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240945168"]
Jul 28 22:58:26.858847 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.858765    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-588rw\" (UniqueName: \"kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw\") pod \"a2aa0da8-2d45-46ce-b253-9a2cf9067174\" (UID: \"a2aa0da8-2d45-46ce-b253-9a2cf9067174\") "
Jul 28 22:58:26.860866 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.860837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw" (OuterVolumeSpecName: "kube-api-access-588rw") pod "a2aa0da8-2d45-46ce-b253-9a2cf9067174" (UID: "a2aa0da8-2d45-46ce-b253-9a2cf9067174"). InnerVolumeSpecName "kube-api-access-588rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:26.910521 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.910484    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:26.910915 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.910902    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2aa0da8-2d45-46ce-b253-9a2cf9067174" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:26.910973 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.910917    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2aa0da8-2d45-46ce-b253-9a2cf9067174" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:26.911007 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.910980    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2aa0da8-2d45-46ce-b253-9a2cf9067174" containerName="test-curl-7545-140584240945168"
Jul 28 22:58:26.914012 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.913993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:26.920236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.920208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:26.960270 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:26.960235    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-588rw\" (UniqueName: \"kubernetes.io/projected/a2aa0da8-2d45-46ce-b253-9a2cf9067174-kube-api-access-588rw\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:27.060944 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.060901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79l92\" (UniqueName: \"kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92\") pod \"test-curl-7545-140584240946176\" (UID: \"73fe5586-c6dd-4e36-8675-5c9b225b728d\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:27.162468 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.162370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79l92\" (UniqueName: \"kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92\") pod \"test-curl-7545-140584240946176\" (UID: \"73fe5586-c6dd-4e36-8675-5c9b225b728d\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:27.170382 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.170349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79l92\" (UniqueName: \"kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92\") pod \"test-curl-7545-140584240946176\" (UID: \"73fe5586-c6dd-4e36-8675-5c9b225b728d\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:27.225301 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.225270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:27.245398 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.245365    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2aa0da8-2d45-46ce-b253-9a2cf9067174" path="/var/lib/kubelet/pods/a2aa0da8-2d45-46ce-b253-9a2cf9067174/volumes"
Jul 28 22:58:27.357568 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.357539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:27.358687 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:27.358659    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73fe5586_c6dd_4e36_8675_5c9b225b728d.slice/crio-b7fdc96c58eb9f8626715ee6f49cb3eb70796eaa424bc8815781c0e91327d115 WatchSource:0}: Error finding container b7fdc96c58eb9f8626715ee6f49cb3eb70796eaa424bc8815781c0e91327d115: Status 404 returned error can't find the container with id b7fdc96c58eb9f8626715ee6f49cb3eb70796eaa424bc8815781c0e91327d115
Jul 28 22:58:27.610448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.610422    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240945168"
Jul 28 22:58:27.610642 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.610466    2563 scope.go:117] "RemoveContainer" containerID="9e19ea15e9082f4dba605241d72064c41fcc16a6a956996519adfb7220381815"
Jul 28 22:58:27.611843 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:27.611782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240946176" event={"ID":"73fe5586-c6dd-4e36-8675-5c9b225b728d","Type":"ContainerStarted","Data":"b7fdc96c58eb9f8626715ee6f49cb3eb70796eaa424bc8815781c0e91327d115"}
Jul 28 22:58:28.623843 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:28.623807    2563 generic.go:356] "Generic (PLEG): container finished" podID="73fe5586-c6dd-4e36-8675-5c9b225b728d" containerID="3891763a65e920237914aec702e319bc0bfe585333865dfd92573d73d4a18162" exitCode=0
Jul 28 22:58:28.624240 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:28.623889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240946176" event={"ID":"73fe5586-c6dd-4e36-8675-5c9b225b728d","Type":"ContainerDied","Data":"3891763a65e920237914aec702e319bc0bfe585333865dfd92573d73d4a18162"}
Jul 28 22:58:29.764611 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.764568    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:29.783825 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.783791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240946176_73fe5586-c6dd-4e36-8675-5c9b225b728d/test-curl-7545-140584240946176/0.log"
Jul 28 22:58:29.809857 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.809814    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:29.813861 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.813831    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:29.890178 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.890082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79l92\" (UniqueName: \"kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92\") pod \"73fe5586-c6dd-4e36-8675-5c9b225b728d\" (UID: \"73fe5586-c6dd-4e36-8675-5c9b225b728d\") "
Jul 28 22:58:29.892196 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.892169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92" (OuterVolumeSpecName: "kube-api-access-79l92") pod "73fe5586-c6dd-4e36-8675-5c9b225b728d" (UID: "73fe5586-c6dd-4e36-8675-5c9b225b728d"). InnerVolumeSpecName "kube-api-access-79l92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:29.929185 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.929155    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:29.929566 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.929552    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73fe5586-c6dd-4e36-8675-5c9b225b728d" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:29.929649 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.929568    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="73fe5586-c6dd-4e36-8675-5c9b225b728d" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:29.929687 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.929660    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="73fe5586-c6dd-4e36-8675-5c9b225b728d" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:29.932696 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.932681    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:29.936780 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.936750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:29.990745 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:29.990717    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79l92\" (UniqueName: \"kubernetes.io/projected/73fe5586-c6dd-4e36-8675-5c9b225b728d-kube-api-access-79l92\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:30.091915 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.091880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkv8\" (UniqueName: \"kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8\") pod \"test-curl-7545-140584240946176\" (UID: \"81ea0de5-c80d-403e-a05f-f0ea433ccebd\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:30.192842 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.192811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkv8\" (UniqueName: \"kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8\") pod \"test-curl-7545-140584240946176\" (UID: \"81ea0de5-c80d-403e-a05f-f0ea433ccebd\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:30.200667 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.200645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkv8\" (UniqueName: \"kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8\") pod \"test-curl-7545-140584240946176\" (UID: \"81ea0de5-c80d-403e-a05f-f0ea433ccebd\") " pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:30.242850 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.242816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:30.396568 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.396538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:30.397451 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:30.397429    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81ea0de5_c80d_403e_a05f_f0ea433ccebd.slice/crio-f36fb52c14b9bd774681bbbf4e5f8a97c5e3d1379b2eb446a25bdea530d2448b WatchSource:0}: Error finding container f36fb52c14b9bd774681bbbf4e5f8a97c5e3d1379b2eb446a25bdea530d2448b: Status 404 returned error can't find the container with id f36fb52c14b9bd774681bbbf4e5f8a97c5e3d1379b2eb446a25bdea530d2448b
Jul 28 22:58:30.636764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.636680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:30.636764 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.636723    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7fdc96c58eb9f8626715ee6f49cb3eb70796eaa424bc8815781c0e91327d115"
Jul 28 22:58:30.637988 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.637962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240946176" event={"ID":"81ea0de5-c80d-403e-a05f-f0ea433ccebd","Type":"ContainerStarted","Data":"f36fb52c14b9bd774681bbbf4e5f8a97c5e3d1379b2eb446a25bdea530d2448b"}
Jul 28 22:58:30.649315 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:30.649284    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7545-140584240946176" oldPodUID="73fe5586-c6dd-4e36-8675-5c9b225b728d" podUID="81ea0de5-c80d-403e-a05f-f0ea433ccebd"
Jul 28 22:58:31.244830 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:31.244794    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73fe5586-c6dd-4e36-8675-5c9b225b728d" path="/var/lib/kubelet/pods/73fe5586-c6dd-4e36-8675-5c9b225b728d/volumes"
Jul 28 22:58:31.645272 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:31.645169    2563 generic.go:356] "Generic (PLEG): container finished" podID="81ea0de5-c80d-403e-a05f-f0ea433ccebd" containerID="9967222d9863f035122958151aa33e4cad6900492448932ef39adbec92e758d2" exitCode=0
Jul 28 22:58:31.645431 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:31.645263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7545-140584240946176" event={"ID":"81ea0de5-c80d-403e-a05f-f0ea433ccebd","Type":"ContainerDied","Data":"9967222d9863f035122958151aa33e4cad6900492448932ef39adbec92e758d2"}
Jul 28 22:58:32.801450 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.801423    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:32.821698 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.821672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7545-140584240946176_81ea0de5-c80d-403e-a05f-f0ea433ccebd/test-curl-7545-140584240946176/0.log"
Jul 28 22:58:32.850084 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.850056    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:32.852242 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.852221    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7545-140584240946176"]
Jul 28 22:58:32.916206 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.916141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvkv8\" (UniqueName: \"kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8\") pod \"81ea0de5-c80d-403e-a05f-f0ea433ccebd\" (UID: \"81ea0de5-c80d-403e-a05f-f0ea433ccebd\") "
Jul 28 22:58:32.918090 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:32.918062    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8" (OuterVolumeSpecName: "kube-api-access-cvkv8") pod "81ea0de5-c80d-403e-a05f-f0ea433ccebd" (UID: "81ea0de5-c80d-403e-a05f-f0ea433ccebd"). InnerVolumeSpecName "kube-api-access-cvkv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:33.017061 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.017019    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvkv8\" (UniqueName: \"kubernetes.io/projected/81ea0de5-c80d-403e-a05f-f0ea433ccebd-kube-api-access-cvkv8\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:58:33.245627 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.245597    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81ea0de5-c80d-403e-a05f-f0ea433ccebd" path="/var/lib/kubelet/pods/81ea0de5-c80d-403e-a05f-f0ea433ccebd/volumes"
Jul 28 22:58:33.336153 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.336113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:33.657709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.657418    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7545-140584240946176"
Jul 28 22:58:33.657709 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.657444    2563 scope.go:117] "RemoveContainer" containerID="9967222d9863f035122958151aa33e4cad6900492448932ef39adbec92e758d2"
Jul 28 22:58:33.669078 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.668995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:33.945510 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:33.945476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:36.727888 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:36.727853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:36.824747 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:36.824711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:36.909939 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:36.909909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:37.368498 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.368462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:37.533233 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.533194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:37.647801 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.647723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:58:37.654062 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.654034    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 22:58:37.654472 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.654457    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81ea0de5-c80d-403e-a05f-f0ea433ccebd" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:37.654530 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.654474    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="81ea0de5-c80d-403e-a05f-f0ea433ccebd" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:37.654569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.654554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="81ea0de5-c80d-403e-a05f-f0ea433ccebd" containerName="test-curl-7545-140584240946176"
Jul 28 22:58:37.658985 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.658969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.661487 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.661464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.661594 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.661492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjj7\" (UniqueName: \"kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.662819 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.662798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ebba94\""
Jul 28 22:58:37.674165 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.674144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 22:58:37.762937 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.762903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.763308 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.762945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjj7\" (UniqueName: \"kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.763622 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.763603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.772427 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.772403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjj7\" (UniqueName: \"kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7\") pod \"payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:37.969569 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:37.969526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:38.104338 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:38.104305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 22:58:38.106725 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:58:38.106695    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733ff29e_4dbb_4b26_a65d_96082fd4bbf4.slice/crio-c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f WatchSource:0}: Error finding container c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f: Status 404 returned error can't find the container with id c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f
Jul 28 22:58:38.692797 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:38.692760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" event={"ID":"733ff29e-4dbb-4b26-a65d-96082fd4bbf4","Type":"ContainerStarted","Data":"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"}
Jul 28 22:58:38.693025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:38.692817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:58:38.693025 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:38.692834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" event={"ID":"733ff29e-4dbb-4b26-a65d-96082fd4bbf4","Type":"ContainerStarted","Data":"c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f"}
Jul 28 22:58:38.710240 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:38.710189    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" podStartSLOduration=1.710174995 podStartE2EDuration="1.710174995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:58:38.708427438 +0000 UTC m=+3246.020666431" watchObservedRunningTime="2026-07-28 22:58:38.710174995 +0000 UTC m=+3246.022413985"
Jul 28 22:58:49.700659 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:58:49.700621    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 22:59:02.489681 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:02.489639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:02.590433 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:02.590398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:02.791227 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:02.791145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:03.226883 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:03.226837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:05.858680 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:05.858643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:05.960100 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:05.960057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:06.074867 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.074835    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 22:59:06.080343 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.080316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.083426 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.083399    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-908e19-serving-cert\""
Jul 28 22:59:06.083555 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.083420    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 22:59:06.084448 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.084431    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-46ntd\""
Jul 28 22:59:06.084564 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.084453    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:59:06.090263 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.090241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 22:59:06.126833 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.126766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:06.206344 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.206317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.206474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.206351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kz2x\" (UniqueName: \"kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.206474 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.206407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.223642 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.223619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:06.307160 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.307131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.307325 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.307167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kz2x\" (UniqueName: \"kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.307325 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.307209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.307943 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.307920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.309686 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.309667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.315512 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.315492    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kz2x\" (UniqueName: \"kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x\") pod \"maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.393928 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.393837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:06.554359 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.554332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 22:59:06.554885 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:59:06.554855    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bf1725_e94b_49a3_bc22_7640d5043401.slice/crio-aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00 WatchSource:0}: Error finding container aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00: Status 404 returned error can't find the container with id aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00
Jul 28 22:59:06.766446 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.766414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:06.865467 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.865428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" event={"ID":"56bf1725-e94b-49a3-bc22-7640d5043401","Type":"ContainerStarted","Data":"aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00"}
Jul 28 22:59:06.872525 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:06.872498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:08.886687 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:08.886647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" event={"ID":"56bf1725-e94b-49a3-bc22-7640d5043401","Type":"ContainerStarted","Data":"6b0de64d21237849ecbf365678837f4c043f5a155485f504d48c830fecb89e36"}
Jul 28 22:59:08.887203 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:08.886833    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:08.906485 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:08.906436    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" podStartSLOduration=0.750399332 podStartE2EDuration="2.906420926s" totalImagesPullingTime="2.156021594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:59:08.904351155 +0000 UTC m=+3276.216590149" watchObservedRunningTime="2026-07-28 22:59:08.906420926 +0000 UTC m=+3276.218659916"
Jul 28 22:59:14.903484 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:14.903449    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 22:59:20.682723 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:20.682687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:33.542126 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:33.542086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:59:33.556759 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:33.556735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 22:59:34.328576 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.328542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:34.332216 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.332199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:34.335379 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.335359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6mmkx\""
Jul 28 22:59:34.342252 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.342229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:34.367954 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.367925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wffc\" (UniqueName: \"kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc\") pod \"kuadrant-operator-catalog-xqxlf\" (UID: \"d306e7a2-b0ac-452b-b138-de92439399bd\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:34.468705 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.468673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wffc\" (UniqueName: \"kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc\") pod \"kuadrant-operator-catalog-xqxlf\" (UID: \"d306e7a2-b0ac-452b-b138-de92439399bd\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:34.481273 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.481248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wffc\" (UniqueName: \"kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc\") pod \"kuadrant-operator-catalog-xqxlf\" (UID: \"d306e7a2-b0ac-452b-b138-de92439399bd\") " pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:34.642665 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.642554    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:34.780181 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:34.780145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:34.781112 ip-10-0-133-142 kubenswrapper[2563]: W0728 22:59:34.781087    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd306e7a2_b0ac_452b_b138_de92439399bd.slice/crio-f6391159403c4f9406c12fc691c560aaf316b0c04985e18e4c10456e80cdb9b3 WatchSource:0}: Error finding container f6391159403c4f9406c12fc691c560aaf316b0c04985e18e4c10456e80cdb9b3: Status 404 returned error can't find the container with id f6391159403c4f9406c12fc691c560aaf316b0c04985e18e4c10456e80cdb9b3
Jul 28 22:59:35.048531 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:35.048488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" event={"ID":"d306e7a2-b0ac-452b-b138-de92439399bd","Type":"ContainerStarted","Data":"f6391159403c4f9406c12fc691c560aaf316b0c04985e18e4c10456e80cdb9b3"}
Jul 28 22:59:37.065499 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:37.065444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" event={"ID":"d306e7a2-b0ac-452b-b138-de92439399bd","Type":"ContainerStarted","Data":"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"}
Jul 28 22:59:37.086454 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:37.086401    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" podStartSLOduration=0.967567314 podStartE2EDuration="3.086384885s" totalImagesPullingTime="2.118817571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:59:37.082936744 +0000 UTC m=+3304.395175736" watchObservedRunningTime="2026-07-28 22:59:37.086384885 +0000 UTC m=+3304.398623874"
Jul 28 22:59:37.711199 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:37.711170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 22:59:43.369545 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:43.369508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 22:59:44.642817 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:44.642778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:44.643237 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:44.642881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:44.664929 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:44.664899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:45.144944 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:45.144911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:45.193128 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:45.193099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:47.134698 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:47.134652    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" podUID="d306e7a2-b0ac-452b-b138-de92439399bd" containerName="registry-server" containerID="cri-o://9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a" gracePeriod=2
Jul 28 22:59:47.395192 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:47.395130    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:47.492236 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:47.492203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wffc\" (UniqueName: \"kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc\") pod \"d306e7a2-b0ac-452b-b138-de92439399bd\" (UID: \"d306e7a2-b0ac-452b-b138-de92439399bd\") "
Jul 28 22:59:47.494308 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:47.494272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc" (OuterVolumeSpecName: "kube-api-access-9wffc") pod "d306e7a2-b0ac-452b-b138-de92439399bd" (UID: "d306e7a2-b0ac-452b-b138-de92439399bd"). InnerVolumeSpecName "kube-api-access-9wffc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:59:47.593010 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:47.592974    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wffc\" (UniqueName: \"kubernetes.io/projected/d306e7a2-b0ac-452b-b138-de92439399bd-kube-api-access-9wffc\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 22:59:48.141784 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.141743    2563 generic.go:356] "Generic (PLEG): container finished" podID="d306e7a2-b0ac-452b-b138-de92439399bd" containerID="9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a" exitCode=0
Jul 28 22:59:48.141784 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.141789    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf"
Jul 28 22:59:48.142261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.141825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" event={"ID":"d306e7a2-b0ac-452b-b138-de92439399bd","Type":"ContainerDied","Data":"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"}
Jul 28 22:59:48.142261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.141873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xqxlf" event={"ID":"d306e7a2-b0ac-452b-b138-de92439399bd","Type":"ContainerDied","Data":"f6391159403c4f9406c12fc691c560aaf316b0c04985e18e4c10456e80cdb9b3"}
Jul 28 22:59:48.142261 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.141893    2563 scope.go:117] "RemoveContainer" containerID="9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"
Jul 28 22:59:48.152848 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.152828    2563 scope.go:117] "RemoveContainer" containerID="9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"
Jul 28 22:59:48.153100 ip-10-0-133-142 kubenswrapper[2563]: E0728 22:59:48.153080    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a\": container with ID starting with 9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a not found: ID does not exist" containerID="9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"
Jul 28 22:59:48.153170 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.153113    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a"} err="failed to get container status \"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a\": rpc error: code = NotFound desc = could not find container \"9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a\": container with ID starting with 9f14ff86b030e796c4735fb958b3a804ec8410e39993beb0bc332f7453fa0b5a not found: ID does not exist"
Jul 28 22:59:48.166176 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.166146    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:48.169299 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:48.169279    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xqxlf"]
Jul 28 22:59:49.251270 ip-10-0-133-142 kubenswrapper[2563]: I0728 22:59:49.251233    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d306e7a2-b0ac-452b-b138-de92439399bd" path="/var/lib/kubelet/pods/d306e7a2-b0ac-452b-b138-de92439399bd/volumes"
Jul 28 23:00:00.144886 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.144778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"]
Jul 28 23:00:00.145455 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.145421    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d306e7a2-b0ac-452b-b138-de92439399bd" containerName="registry-server"
Jul 28 23:00:00.145455 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.145452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d306e7a2-b0ac-452b-b138-de92439399bd" containerName="registry-server"
Jul 28 23:00:00.145672 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.145654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d306e7a2-b0ac-452b-b138-de92439399bd" containerName="registry-server"
Jul 28 23:00:00.150131 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.150112    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"]
Jul 28 23:00:00.150267 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.150246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"
Jul 28 23:00:00.153469 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.153447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:00:00.153599 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.153488    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"]
Jul 28 23:00:00.153670 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.153629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"
Jul 28 23:00:00.157320 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.157299    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"]
Jul 28 23:00:00.157934 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.157532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"
Jul 28 23:00:00.161936 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.161910    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"]
Jul 28 23:00:00.162498 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.162476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"
Jul 28 23:00:00.166412 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.166233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"
Jul 28 23:00:00.174104 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.173977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"]
Jul 28 23:00:00.174104 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.174014    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"
Jul 28 23:00:00.174104 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.174043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"]
Jul 28 23:00:00.174104 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.174074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"]
Jul 28 23:00:00.174104 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.174100    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"]
Jul 28 23:00:00.179632 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.179575    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"
Jul 28 23:00:00.180515 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.180452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"]
Jul 28 23:00:00.229420 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.229397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"
Jul 28 23:00:00.248528 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.248312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"
Jul 28 23:00:00.301172 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.301146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"
Jul 28 23:00:00.440140 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.440110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"]
Jul 28 23:00:00.443335 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:00.442462    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03385d45_5ee9_44e4_8487_33d72a9835ec.slice/crio-2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9 WatchSource:0}: Error finding container 2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9: Status 404 returned error can't find the container with id 2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9
Jul 28 23:00:00.471133 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.471088    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"]
Jul 28 23:00:00.472465 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:00.472433    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f254278_cd0e_4541_b871_6b03d862cd7a.slice/crio-f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941 WatchSource:0}: Error finding container f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941: Status 404 returned error can't find the container with id f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941
Jul 28 23:00:00.496941 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.496902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"]
Jul 28 23:00:00.509729 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:00.509706    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b5e7e8_0df7_41b2_a543_179bcb6704e4.slice/crio-fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e WatchSource:0}: Error finding container fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e: Status 404 returned error can't find the container with id fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e
Jul 28 23:00:00.568731 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.568707    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"]
Jul 28 23:00:00.569908 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:00.569887    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf098574f_3f4b_41de_acf9_56bda51cdd56.slice/crio-08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e WatchSource:0}: Error finding container 08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e: Status 404 returned error can't find the container with id 08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e
Jul 28 23:00:00.601888 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:00.601859    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"]
Jul 28 23:00:00.603182 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:00.603156    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c2780f_ad01_410e_b977_100d79fcecd1.slice/crio-d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a WatchSource:0}: Error finding container d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a: Status 404 returned error can't find the container with id d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a
Jul 28 23:00:01.218978 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.218843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv" event={"ID":"f4b5e7e8-0df7-41b2-a543-179bcb6704e4","Type":"ContainerStarted","Data":"33406fb3441fe0d20202f3645e186f39595a6bc8118818256b07d70bce83f7cb"}
Jul 28 23:00:01.218978 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.218905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv" event={"ID":"f4b5e7e8-0df7-41b2-a543-179bcb6704e4","Type":"ContainerStarted","Data":"fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e"}
Jul 28 23:00:01.220496 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.220464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc" event={"ID":"8f254278-cd0e-4541-b871-6b03d862cd7a","Type":"ContainerStarted","Data":"0fc8a77ad9892038a94d1bf48719dea4709e6c16f800dc42d0c0d4eaf956e6e0"}
Jul 28 23:00:01.220611 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.220525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc" event={"ID":"8f254278-cd0e-4541-b871-6b03d862cd7a","Type":"ContainerStarted","Data":"f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941"}
Jul 28 23:00:01.221912 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.221888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9" event={"ID":"f7c2780f-ad01-410e-b977-100d79fcecd1","Type":"ContainerStarted","Data":"35aca27472b2a5d498cf5610b6a6c917867f938cab1289ef63e09e4580922c36"}
Jul 28 23:00:01.222023 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.221930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9" event={"ID":"f7c2780f-ad01-410e-b977-100d79fcecd1","Type":"ContainerStarted","Data":"d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a"}
Jul 28 23:00:01.223340 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.223316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx" event={"ID":"f098574f-3f4b-41de-acf9-56bda51cdd56","Type":"ContainerStarted","Data":"d4340cf17c7766e440847b44c6b709d48548524157743a85327c02a79c51cbc4"}
Jul 28 23:00:01.223446 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.223360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx" event={"ID":"f098574f-3f4b-41de-acf9-56bda51cdd56","Type":"ContainerStarted","Data":"08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e"}
Jul 28 23:00:01.224880 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.224863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8" event={"ID":"03385d45-5ee9-44e4-8487-33d72a9835ec","Type":"ContainerStarted","Data":"dec8dbd81045306f9438ec5e67ada9e6b2c0f401c6ae5959130dd023a7f9538b"}
Jul 28 23:00:01.224932 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.224899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8" event={"ID":"03385d45-5ee9-44e4-8487-33d72a9835ec","Type":"ContainerStarted","Data":"2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9"}
Jul 28 23:00:01.255785 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.255740    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv" podStartSLOduration=1.255725786 podStartE2EDuration="1.255725786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:01.254302636 +0000 UTC m=+3328.566541626" watchObservedRunningTime="2026-07-28 23:00:01.255725786 +0000 UTC m=+3328.567964809"
Jul 28 23:00:01.286298 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.286251    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9" podStartSLOduration=1.286236919 podStartE2EDuration="1.286236919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:01.283798122 +0000 UTC m=+3328.596037115" watchObservedRunningTime="2026-07-28 23:00:01.286236919 +0000 UTC m=+3328.598475910"
Jul 28 23:00:01.300839 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.300795    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8" podStartSLOduration=1.300780683 podStartE2EDuration="1.300780683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:01.300170961 +0000 UTC m=+3328.612409952" watchObservedRunningTime="2026-07-28 23:00:01.300780683 +0000 UTC m=+3328.613019705"
Jul 28 23:00:01.319438 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.319394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx" podStartSLOduration=1.319379243 podStartE2EDuration="1.319379243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:01.31654984 +0000 UTC m=+3328.628788830" watchObservedRunningTime="2026-07-28 23:00:01.319379243 +0000 UTC m=+3328.631618271"
Jul 28 23:00:01.334847 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:01.334800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc" podStartSLOduration=1.334786872 podStartE2EDuration="1.334786872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:01.334142902 +0000 UTC m=+3328.646381894" watchObservedRunningTime="2026-07-28 23:00:01.334786872 +0000 UTC m=+3328.647025862"
Jul 28 23:00:02.233297 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.233260    2563 generic.go:356] "Generic (PLEG): container finished" podID="03385d45-5ee9-44e4-8487-33d72a9835ec" containerID="dec8dbd81045306f9438ec5e67ada9e6b2c0f401c6ae5959130dd023a7f9538b" exitCode=0
Jul 28 23:00:02.233775 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.233342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8" event={"ID":"03385d45-5ee9-44e4-8487-33d72a9835ec","Type":"ContainerDied","Data":"dec8dbd81045306f9438ec5e67ada9e6b2c0f401c6ae5959130dd023a7f9538b"}
Jul 28 23:00:02.235248 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.235219    2563 generic.go:356] "Generic (PLEG): container finished" podID="f4b5e7e8-0df7-41b2-a543-179bcb6704e4" containerID="33406fb3441fe0d20202f3645e186f39595a6bc8118818256b07d70bce83f7cb" exitCode=0
Jul 28 23:00:02.235423 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.235294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv" event={"ID":"f4b5e7e8-0df7-41b2-a543-179bcb6704e4","Type":"ContainerDied","Data":"33406fb3441fe0d20202f3645e186f39595a6bc8118818256b07d70bce83f7cb"}
Jul 28 23:00:02.237204 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.237181    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f254278-cd0e-4541-b871-6b03d862cd7a" containerID="0fc8a77ad9892038a94d1bf48719dea4709e6c16f800dc42d0c0d4eaf956e6e0" exitCode=0
Jul 28 23:00:02.237353 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.237274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc" event={"ID":"8f254278-cd0e-4541-b871-6b03d862cd7a","Type":"ContainerDied","Data":"0fc8a77ad9892038a94d1bf48719dea4709e6c16f800dc42d0c0d4eaf956e6e0"}
Jul 28 23:00:02.239187 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.239165    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7c2780f-ad01-410e-b977-100d79fcecd1" containerID="35aca27472b2a5d498cf5610b6a6c917867f938cab1289ef63e09e4580922c36" exitCode=0
Jul 28 23:00:02.239310 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.239191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9" event={"ID":"f7c2780f-ad01-410e-b977-100d79fcecd1","Type":"ContainerDied","Data":"35aca27472b2a5d498cf5610b6a6c917867f938cab1289ef63e09e4580922c36"}
Jul 28 23:00:02.240796 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.240773    2563 generic.go:356] "Generic (PLEG): container finished" podID="f098574f-3f4b-41de-acf9-56bda51cdd56" containerID="d4340cf17c7766e440847b44c6b709d48548524157743a85327c02a79c51cbc4" exitCode=0
Jul 28 23:00:02.240907 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:02.240815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx" event={"ID":"f098574f-3f4b-41de-acf9-56bda51cdd56","Type":"ContainerDied","Data":"d4340cf17c7766e440847b44c6b709d48548524157743a85327c02a79c51cbc4"}
Jul 28 23:00:03.437463 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:03.437431    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"
Jul 28 23:00:03.511906 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:03.511426    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"
Jul 28 23:00:03.515216 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:03.515189    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"
Jul 28 23:00:03.518865 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:03.518844    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"
Jul 28 23:00:03.552350 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:03.551757    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"
Jul 28 23:00:04.253837 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.253809    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"
Jul 28 23:00:04.254011 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.253862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc" event={"ID":"8f254278-cd0e-4541-b871-6b03d862cd7a","Type":"ContainerDied","Data":"f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941"}
Jul 28 23:00:04.254011 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.253910    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4fcf677591a4943d0a98a8181b74305b2b407d8339f5f53b59a9931bd29d941"
Jul 28 23:00:04.255198 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.255173    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"
Jul 28 23:00:04.255336 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.255172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9" event={"ID":"f7c2780f-ad01-410e-b977-100d79fcecd1","Type":"ContainerDied","Data":"d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a"}
Jul 28 23:00:04.255336 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.255307    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7d8db5693b97e7695e09972df26efaef94e8f30f28a9db410d3f14b4bd3dd9a"
Jul 28 23:00:04.256477 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.256458    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx"
Jul 28 23:00:04.256627 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.256488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754660-wdcdx" event={"ID":"f098574f-3f4b-41de-acf9-56bda51cdd56","Type":"ContainerDied","Data":"08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e"}
Jul 28 23:00:04.256627 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.256532    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08c36b39db0bb4126514835385f4c8598a0299f016bd75eda8616aacb401e99e"
Jul 28 23:00:04.257916 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.257894    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"
Jul 28 23:00:04.258023 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.257944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8" event={"ID":"03385d45-5ee9-44e4-8487-33d72a9835ec","Type":"ContainerDied","Data":"2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9"}
Jul 28 23:00:04.258023 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.257982    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c6789abb57b7b29bc5bace2b12a3d189af8803f3d27c05f79d1236aec7945f9"
Jul 28 23:00:04.259440 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.259414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv" event={"ID":"f4b5e7e8-0df7-41b2-a543-179bcb6704e4","Type":"ContainerDied","Data":"fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e"}
Jul 28 23:00:04.259440 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.259433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"
Jul 28 23:00:04.259676 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:04.259458    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd78ec5310f4f9fc948cec9d6182ba9b623f25d1abb26f1bb7d0be7fcd451d3e"
Jul 28 23:00:13.529794 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:13.529755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:29.931302 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:29.931261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms_733ff29e-4dbb-4b26-a65d-96082fd4bbf4/payload-processing/0.log"
Jul 28 23:00:30.058993 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.058967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 23:00:30.171943 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.171907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:30.596859 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.596828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:30.876381 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876303    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:00:30.876747 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876734    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f254278-cd0e-4541-b871-6b03d862cd7a" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876749    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f254278-cd0e-4541-b871-6b03d862cd7a" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876761    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c2780f-ad01-410e-b977-100d79fcecd1" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876766    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c2780f-ad01-410e-b977-100d79fcecd1" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876776    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03385d45-5ee9-44e4-8487-33d72a9835ec" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876781    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03385d45-5ee9-44e4-8487-33d72a9835ec" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876790    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b5e7e8-0df7-41b2-a543-179bcb6704e4" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876794    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b5e7e8-0df7-41b2-a543-179bcb6704e4" containerName="cleanup"
Jul 28 23:00:30.876805 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876806    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f098574f-3f4b-41de-acf9-56bda51cdd56" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f098574f-3f4b-41de-acf9-56bda51cdd56" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876870    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b5e7e8-0df7-41b2-a543-179bcb6704e4" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876880    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f254278-cd0e-4541-b871-6b03d862cd7a" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876887    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03385d45-5ee9-44e4-8487-33d72a9835ec" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876894    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c2780f-ad01-410e-b977-100d79fcecd1" containerName="cleanup"
Jul 28 23:00:30.877048 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.876900    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f098574f-3f4b-41de-acf9-56bda51cdd56" containerName="cleanup"
Jul 28 23:00:30.880177 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.880157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.882964 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.882937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-76d3be-openshift-default-dockercfg-2sw8h\""
Jul 28 23:00:30.883407 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.883390    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 23:00:30.891481 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.891459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:00:30.975846 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.975811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.975888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.975909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.975931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.975963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qr8\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.976000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.976021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.976072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:30.976254 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:30.976101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077435 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077775 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077836 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qr8\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077892 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.077892 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.078000 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.078000 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.077934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.078108 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.078074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.078228 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.078207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.078299 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.078284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.080095 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.080064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.080193 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.080170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.086414 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.086395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.086492 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.086457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qr8\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8\") pod \"e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") " pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.193205 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.193174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:31.270681 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.270648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:31.338886 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.338851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:00:31.340031 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:31.340003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fad2169_1db2_4d43_9b8e_b61fc9205a8e.slice/crio-1a44e86a76291a7defa7b8c292457468031b61b8313c2cf97c199b334d466c2c WatchSource:0}: Error finding container 1a44e86a76291a7defa7b8c292457468031b61b8313c2cf97c199b334d466c2c: Status 404 returned error can't find the container with id 1a44e86a76291a7defa7b8c292457468031b61b8313c2cf97c199b334d466c2c
Jul 28 23:00:31.340152 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.340108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:31.423242 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:31.423202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerStarted","Data":"1a44e86a76291a7defa7b8c292457468031b61b8313c2cf97c199b334d466c2c"}
Jul 28 23:00:42.495911 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:42.495869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:00:42.496307 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:42.495960    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:00:42.496307 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:42.496039    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:00:43.499489 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:43.499452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerStarted","Data":"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"}
Jul 28 23:00:43.524476 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:43.524416    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podStartSLOduration=2.371128286 podStartE2EDuration="13.524399369s" totalImagesPullingTime="11.153271083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:43.521035186 +0000 UTC m=+3370.833274207" watchObservedRunningTime="2026-07-28 23:00:43.524399369 +0000 UTC m=+3370.836638437"
Jul 28 23:00:44.193792 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:44.193758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:44.198951 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:44.198923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:44.505721 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:44.505627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:44.506670 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:44.506628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:00:45.857219 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:45.857183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:45.955531 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:45.955500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:46.176069 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.175986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:46.567691 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.567647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:46.729489 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.729460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:46.830675 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.830563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:00:46.875166 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.875135    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:00:46.878767 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.878750    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:46.881656 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.881624    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-76d3be\""
Jul 28 23:00:46.881781 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.881750    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-76d3be-dockercfg-jlng9\""
Jul 28 23:00:46.887334 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.887309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:00:46.927988 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.927954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:46.928152 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:46.928111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqsdb\" (UniqueName: \"kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.029444 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.029396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqsdb\" (UniqueName: \"kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.029664 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.029453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.030202 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.030182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.038919 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.038897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqsdb\" (UniqueName: \"kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb\") pod \"payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.191571 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.191533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.342432 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.342404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:00:47.343008 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:00:47.342983    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d24639_943d_49e3_9d35_0fe06c54728a.slice/crio-1df984e08b8c1cbf4ff61d5ae4db04389fe538aca2dec767c04c54dc40e82aa2 WatchSource:0}: Error finding container 1df984e08b8c1cbf4ff61d5ae4db04389fe538aca2dec767c04c54dc40e82aa2: Status 404 returned error can't find the container with id 1df984e08b8c1cbf4ff61d5ae4db04389fe538aca2dec767c04c54dc40e82aa2
Jul 28 23:00:47.526280 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.526201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" event={"ID":"c7d24639-943d-49e3-9d35-0fe06c54728a","Type":"ContainerStarted","Data":"5007f7d46ed4acff92cf50e42e66d7a41f9a5f0e2f31bbe7c67d56ba96d05584"}
Jul 28 23:00:47.526280 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.526263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" event={"ID":"c7d24639-943d-49e3-9d35-0fe06c54728a","Type":"ContainerStarted","Data":"1df984e08b8c1cbf4ff61d5ae4db04389fe538aca2dec767c04c54dc40e82aa2"}
Jul 28 23:00:47.526463 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.526405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:00:47.544822 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:47.544769    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" podStartSLOduration=1.5447539369999999 podStartE2EDuration="1.544753937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:00:47.541816992 +0000 UTC m=+3374.854055984" watchObservedRunningTime="2026-07-28 23:00:47.544753937 +0000 UTC m=+3374.856992925"
Jul 28 23:00:58.535518 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:00:58.535485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:01:00.242914 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:00.242881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:00.932502 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:00.932458    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"]
Jul 28 23:01:00.939846 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:00.939815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:00.942541 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:00.942514    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:01:00.943852 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:00.943828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"]
Jul 28 23:01:01.065229 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.065194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc\" (UID: \"c93cd75c-2986-4584-be49-e53f54a8ca3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:01.166404 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.166356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc\" (UID: \"c93cd75c-2986-4584-be49-e53f54a8ca3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:01.167056 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.167032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc\" (UID: \"c93cd75c-2986-4584-be49-e53f54a8ca3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:01.254606 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.254499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:01.421392 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.421334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"]
Jul 28 23:01:01.421784 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:01:01.421757    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93cd75c_2986_4584_be49_e53f54a8ca3a.slice/crio-4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924 WatchSource:0}: Error finding container 4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924: Status 404 returned error can't find the container with id 4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924
Jul 28 23:01:01.622782 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:01.622747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc" event={"ID":"c93cd75c-2986-4584-be49-e53f54a8ca3a","Type":"ContainerStarted","Data":"4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924"}
Jul 28 23:01:02.630661 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:02.630621    2563 generic.go:356] "Generic (PLEG): container finished" podID="c93cd75c-2986-4584-be49-e53f54a8ca3a" containerID="9c902ce1e13649579a9d9175ddde60d7a1c647657e954e26cca4a3f10f1df710" exitCode=0
Jul 28 23:01:02.631065 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:02.630710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc" event={"ID":"c93cd75c-2986-4584-be49-e53f54a8ca3a","Type":"ContainerDied","Data":"9c902ce1e13649579a9d9175ddde60d7a1c647657e954e26cca4a3f10f1df710"}
Jul 28 23:01:03.638719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.638632    2563 generic.go:356] "Generic (PLEG): container finished" podID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerID="cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2" exitCode=0
Jul 28 23:01:03.638719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.638706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerDied","Data":"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"}
Jul 28 23:01:03.639492 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.639213    2563 scope.go:117] "RemoveContainer" containerID="cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"
Jul 28 23:01:03.641391 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.641361    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:01:03.641481 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.641428    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:01:03.641481 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.641460    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 23:01:03.802644 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.802613    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:03.893449 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.893349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca\") pod \"c93cd75c-2986-4584-be49-e53f54a8ca3a\" (UID: \"c93cd75c-2986-4584-be49-e53f54a8ca3a\") "
Jul 28 23:01:03.893725 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.893704    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c93cd75c-2986-4584-be49-e53f54a8ca3a" (UID: "c93cd75c-2986-4584-be49-e53f54a8ca3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:01:03.995065 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:03.995026    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93cd75c-2986-4584-be49-e53f54a8ca3a-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:04.646634 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:04.646591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerStarted","Data":"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"}
Jul 28 23:01:04.647954 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:04.647929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc" event={"ID":"c93cd75c-2986-4584-be49-e53f54a8ca3a","Type":"ContainerDied","Data":"4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924"}
Jul 28 23:01:04.648081 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:04.647967    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4af36f8715568dc8efcf6053e325a22c33235251a0b18044d1ae552ed308f924"
Jul 28 23:01:04.648081 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:04.647933    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"
Jul 28 23:01:05.194152 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:05.194105    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:05.194702 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:05.194657    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 23:01:05.194844 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:05.194753    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 23:01:06.194110 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:06.194058    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 23:01:06.194657 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:06.194134    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 23:01:07.194180 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:07.194130    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 23:01:07.194701 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:07.194218    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 23:01:08.193922 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.193882    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 28 23:01:08.194232 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.194196    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 28 23:01:08.395466 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.395430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:08.426986 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.426953    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:01:08.427246 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.427216    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerName="payload-processing" containerID="cri-o://5007f7d46ed4acff92cf50e42e66d7a41f9a5f0e2f31bbe7c67d56ba96d05584" gracePeriod=30
Jul 28 23:01:08.465729 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.465673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:08.534378 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.534334    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.80:9004: connect: connection refused"
Jul 28 23:01:08.559499 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.559452    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"]
Jul 28 23:01:08.560253 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.560222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:08.562400 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.562379    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-76d3be-6prnc"]
Jul 28 23:01:08.640473 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.640434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:08.682668 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.682632    2563 generic.go:356] "Generic (PLEG): container finished" podID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerID="5007f7d46ed4acff92cf50e42e66d7a41f9a5f0e2f31bbe7c67d56ba96d05584" exitCode=0
Jul 28 23:01:08.682864 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.682708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" event={"ID":"c7d24639-943d-49e3-9d35-0fe06c54728a","Type":"ContainerDied","Data":"5007f7d46ed4acff92cf50e42e66d7a41f9a5f0e2f31bbe7c67d56ba96d05584"}
Jul 28 23:01:08.728276 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.728251    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:01:08.738905 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.738880    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqsdb\" (UniqueName: \"kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb\") pod \"c7d24639-943d-49e3-9d35-0fe06c54728a\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") "
Jul 28 23:01:08.739046 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.738915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume\") pod \"c7d24639-943d-49e3-9d35-0fe06c54728a\" (UID: \"c7d24639-943d-49e3-9d35-0fe06c54728a\") "
Jul 28 23:01:08.739325 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.739300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7d24639-943d-49e3-9d35-0fe06c54728a" (UID: "c7d24639-943d-49e3-9d35-0fe06c54728a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:01:08.740926 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.740902    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb" (OuterVolumeSpecName: "kube-api-access-rqsdb") pod "c7d24639-943d-49e3-9d35-0fe06c54728a" (UID: "c7d24639-943d-49e3-9d35-0fe06c54728a"). InnerVolumeSpecName "kube-api-access-rqsdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:01:08.839896 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.839862    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqsdb\" (UniqueName: \"kubernetes.io/projected/c7d24639-943d-49e3-9d35-0fe06c54728a-kube-api-access-rqsdb\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:08.839896 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.839890    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7d24639-943d-49e3-9d35-0fe06c54728a-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:08.917547 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:08.917506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:09.196928 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.196893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:09.197412 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.197318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:09.198068 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.198049    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:09.246076 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.246044    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c93cd75c-2986-4584-be49-e53f54a8ca3a" path="/var/lib/kubelet/pods/c93cd75c-2986-4584-be49-e53f54a8ca3a/volumes"
Jul 28 23:01:09.690785 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.690757    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"
Jul 28 23:01:09.690953 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.690802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh" event={"ID":"c7d24639-943d-49e3-9d35-0fe06c54728a","Type":"ContainerDied","Data":"1df984e08b8c1cbf4ff61d5ae4db04389fe538aca2dec767c04c54dc40e82aa2"}
Jul 28 23:01:09.690953 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.690868    2563 scope.go:117] "RemoveContainer" containerID="5007f7d46ed4acff92cf50e42e66d7a41f9a5f0e2f31bbe7c67d56ba96d05584"
Jul 28 23:01:09.708679 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.708647    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:01:09.711264 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:09.711245    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-76d3be-7b47d7bb86-k85xh"]
Jul 28 23:01:11.244813 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:11.244781    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" path="/var/lib/kubelet/pods/c7d24639-943d-49e3-9d35-0fe06c54728a/volumes"
Jul 28 23:01:14.954873 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:14.954842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:15.050526 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:15.050493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:15.198464 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:15.198429    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:01:15.198746 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:15.198691    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy" containerID="cri-o://ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e" gracePeriod=30
Jul 28 23:01:15.206345 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:15.206280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:16.096678 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:16.096642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:19.667297 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.667262    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"]
Jul 28 23:01:19.667960 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.667939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93cd75c-2986-4584-be49-e53f54a8ca3a" containerName="revoke-keys"
Jul 28 23:01:19.668045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.667962    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93cd75c-2986-4584-be49-e53f54a8ca3a" containerName="revoke-keys"
Jul 28 23:01:19.668045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.667991    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerName="payload-processing"
Jul 28 23:01:19.668045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.668000    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerName="payload-processing"
Jul 28 23:01:19.668215 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.668103    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93cd75c-2986-4584-be49-e53f54a8ca3a" containerName="revoke-keys"
Jul 28 23:01:19.668215 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.668117    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d24639-943d-49e3-9d35-0fe06c54728a" containerName="payload-processing"
Jul 28 23:01:19.671514 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.671493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:19.674183 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.674155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:01:19.677851 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.677823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"]
Jul 28 23:01:19.739536 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.739503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm\" (UID: \"77e05758-8e42-40b0-a751-0ba891fd2806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:19.840045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.840006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm\" (UID: \"77e05758-8e42-40b0-a751-0ba891fd2806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:19.840707 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.840689    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm\" (UID: \"77e05758-8e42-40b0-a751-0ba891fd2806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:19.985105 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:19.985072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:20.123453 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.123423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"]
Jul 28 23:01:20.124819 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:01:20.124795    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e05758_8e42_40b0_a751_0ba891fd2806.slice/crio-d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3 WatchSource:0}: Error finding container d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3: Status 404 returned error can't find the container with id d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3
Jul 28 23:01:20.457477 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.457451    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:20.547195 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547156    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7qr8\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547717 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547408    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547717 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547717 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data\") pod \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\" (UID: \"6fad2169-1db2-4d43-9b8e-b61fc9205a8e\") "
Jul 28 23:01:20.547717 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547563    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:20.547917 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547898    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:20.547974 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.547908    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-certs\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.548110 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.548089    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:20.548194 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.548140    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:01:20.548576 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.548550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:20.549688 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.549661    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:01:20.549688 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.549678    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:20.549942 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.549912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 23:01:20.550057 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.549915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8" (OuterVolumeSpecName: "kube-api-access-p7qr8") pod "6fad2169-1db2-4d43-9b8e-b61fc9205a8e" (UID: "6fad2169-1db2-4d43-9b8e-b61fc9205a8e"). InnerVolumeSpecName "kube-api-access-p7qr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649410    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-workload-socket\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649440    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-credential-socket\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649451    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-data\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649459    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-envoy\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649467    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-token\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649478    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7qr8\" (UniqueName: \"kubernetes.io/projected/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-kube-api-access-p7qr8\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649490 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649490    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istio-podinfo\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.649852 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.649500    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fad2169-1db2-4d43-9b8e-b61fc9205a8e-istiod-ca-cert\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:20.765100 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.765063    2563 generic.go:356] "Generic (PLEG): container finished" podID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerID="ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e" exitCode=0
Jul 28 23:01:20.765590 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.765112    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"
Jul 28 23:01:20.765590 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.765145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerDied","Data":"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"}
Jul 28 23:01:20.765590 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.765222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs" event={"ID":"6fad2169-1db2-4d43-9b8e-b61fc9205a8e","Type":"ContainerDied","Data":"1a44e86a76291a7defa7b8c292457468031b61b8313c2cf97c199b334d466c2c"}
Jul 28 23:01:20.765590 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.765257    2563 scope.go:117] "RemoveContainer" containerID="ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"
Jul 28 23:01:20.766876 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.766849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm" event={"ID":"77e05758-8e42-40b0-a751-0ba891fd2806","Type":"ContainerStarted","Data":"0068fe592cabd6d489f9319156d5b21fee60c5231dc581d9798667107d8b9b44"}
Jul 28 23:01:20.767016 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.766931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm" event={"ID":"77e05758-8e42-40b0-a751-0ba891fd2806","Type":"ContainerStarted","Data":"d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3"}
Jul 28 23:01:20.776161 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.776142    2563 scope.go:117] "RemoveContainer" containerID="cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"
Jul 28 23:01:20.785699 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.785680    2563 scope.go:117] "RemoveContainer" containerID="ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"
Jul 28 23:01:20.785940 ip-10-0-133-142 kubenswrapper[2563]: E0728 23:01:20.785919    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e\": container with ID starting with ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e not found: ID does not exist" containerID="ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"
Jul 28 23:01:20.785986 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.785947    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e"} err="failed to get container status \"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e\": rpc error: code = NotFound desc = could not find container \"ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e\": container with ID starting with ee36ea03270409c757bf14c908a5d0c1f18d4bb97228a669d246e6d5c7c75a1e not found: ID does not exist"
Jul 28 23:01:20.785986 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.785963    2563 scope.go:117] "RemoveContainer" containerID="cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"
Jul 28 23:01:20.786223 ip-10-0-133-142 kubenswrapper[2563]: E0728 23:01:20.786203    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2\": container with ID starting with cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2 not found: ID does not exist" containerID="cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"
Jul 28 23:01:20.786271 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.786231    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2"} err="failed to get container status \"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2\": rpc error: code = NotFound desc = could not find container \"cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2\": container with ID starting with cada2522229be9786d8dcf3cd4bf0492d0500e63c7cc27f0ad51c173864847b2 not found: ID does not exist"
Jul 28 23:01:20.798622 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.798561    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm" podStartSLOduration=1.798548919 podStartE2EDuration="1.798548919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:01:20.784568077 +0000 UTC m=+3408.096807070" watchObservedRunningTime="2026-07-28 23:01:20.798548919 +0000 UTC m=+3408.110787909"
Jul 28 23:01:20.798942 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.798923    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:01:20.804291 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:20.804271    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-76d3be-openshift-default-646f89757d-2vhjs"]
Jul 28 23:01:21.245604 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:21.245537    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" path="/var/lib/kubelet/pods/6fad2169-1db2-4d43-9b8e-b61fc9205a8e/volumes"
Jul 28 23:01:21.775957 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:21.775921    2563 generic.go:356] "Generic (PLEG): container finished" podID="77e05758-8e42-40b0-a751-0ba891fd2806" containerID="0068fe592cabd6d489f9319156d5b21fee60c5231dc581d9798667107d8b9b44" exitCode=0
Jul 28 23:01:21.776353 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:21.776008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm" event={"ID":"77e05758-8e42-40b0-a751-0ba891fd2806","Type":"ContainerDied","Data":"0068fe592cabd6d489f9319156d5b21fee60c5231dc581d9798667107d8b9b44"}
Jul 28 23:01:22.923430 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:22.923400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:22.970504 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:22.970471    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca\") pod \"77e05758-8e42-40b0-a751-0ba891fd2806\" (UID: \"77e05758-8e42-40b0-a751-0ba891fd2806\") "
Jul 28 23:01:22.970884 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:22.970865    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77e05758-8e42-40b0-a751-0ba891fd2806" (UID: "77e05758-8e42-40b0-a751-0ba891fd2806"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:01:23.071949 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:23.071866    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e05758-8e42-40b0-a751-0ba891fd2806-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:23.789531 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:23.789501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"
Jul 28 23:01:23.789725 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:23.789501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm" event={"ID":"77e05758-8e42-40b0-a751-0ba891fd2806","Type":"ContainerDied","Data":"d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3"}
Jul 28 23:01:23.789725 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:23.789640    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4567a654a563c042406779871ddb9be3b389e9a7e91c56bf18167957193d1a3"
Jul 28 23:01:33.971670 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:33.971469    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"]
Jul 28 23:01:33.974646 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:33.974620    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-ebba94-29754660-d7xd8"]
Jul 28 23:01:33.975128 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:33.975103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:34.001111 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.001063    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 23:01:34.001625 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.001549    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" podUID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" containerName="payload-processing" containerID="cri-o://005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef" gracePeriod=30
Jul 28 23:01:34.133967 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.133934    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"]
Jul 28 23:01:34.136558 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.136530    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ebba94-p5ttm"]
Jul 28 23:01:34.265366 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.265341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 23:01:34.371482 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.371446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkjj7\" (UniqueName: \"kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7\") pod \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") "
Jul 28 23:01:34.371708 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.371501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume\") pod \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\" (UID: \"733ff29e-4dbb-4b26-a65d-96082fd4bbf4\") "
Jul 28 23:01:34.371949 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.371926    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "733ff29e-4dbb-4b26-a65d-96082fd4bbf4" (UID: "733ff29e-4dbb-4b26-a65d-96082fd4bbf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:01:34.373575 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.373554    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7" (OuterVolumeSpecName: "kube-api-access-kkjj7") pod "733ff29e-4dbb-4b26-a65d-96082fd4bbf4" (UID: "733ff29e-4dbb-4b26-a65d-96082fd4bbf4"). InnerVolumeSpecName "kube-api-access-kkjj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:01:34.472835 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.472800    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkjj7\" (UniqueName: \"kubernetes.io/projected/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-kube-api-access-kkjj7\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:34.472835 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.472829    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733ff29e-4dbb-4b26-a65d-96082fd4bbf4-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:01:34.860098 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.860066    2563 generic.go:356] "Generic (PLEG): container finished" podID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" containerID="005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef" exitCode=0
Jul 28 23:01:34.860291 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.860106    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"
Jul 28 23:01:34.860291 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.860150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" event={"ID":"733ff29e-4dbb-4b26-a65d-96082fd4bbf4","Type":"ContainerDied","Data":"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"}
Jul 28 23:01:34.860291 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.860217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms" event={"ID":"733ff29e-4dbb-4b26-a65d-96082fd4bbf4","Type":"ContainerDied","Data":"c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f"}
Jul 28 23:01:34.860291 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.860251    2563 scope.go:117] "RemoveContainer" containerID="005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"
Jul 28 23:01:34.876765 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.876739    2563 scope.go:117] "RemoveContainer" containerID="005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"
Jul 28 23:01:34.877204 ip-10-0-133-142 kubenswrapper[2563]: E0728 23:01:34.877175    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef\": container with ID starting with 005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef not found: ID does not exist" containerID="005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"
Jul 28 23:01:34.877302 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.877213    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef"} err="failed to get container status \"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef\": rpc error: code = NotFound desc = could not find container \"005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef\": container with ID starting with 005c7694b485fc33420e960b36aa803a6661f2c2fbeecdf972bd18b7134592ef not found: ID does not exist"
Jul 28 23:01:34.885120 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.885089    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 23:01:34.889782 ip-10-0-133-142 kubenswrapper[2563]: E0728 23:01:34.889754    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733ff29e_4dbb_4b26_a65d_96082fd4bbf4.slice/crio-c0a07c4c57db730a7333dc0cba64728bb848dcee51b17264ac4fb4b867ee135f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733ff29e_4dbb_4b26_a65d_96082fd4bbf4.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 23:01:34.890014 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:34.889996    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ebba94-55cd8876cb-l8fms"]
Jul 28 23:01:35.245522 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:35.245484    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03385d45-5ee9-44e4-8487-33d72a9835ec" path="/var/lib/kubelet/pods/03385d45-5ee9-44e4-8487-33d72a9835ec/volumes"
Jul 28 23:01:35.245934 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:35.245861    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" path="/var/lib/kubelet/pods/733ff29e-4dbb-4b26-a65d-96082fd4bbf4/volumes"
Jul 28 23:01:35.246162 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:35.246149    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e05758-8e42-40b0-a751-0ba891fd2806" path="/var/lib/kubelet/pods/77e05758-8e42-40b0-a751-0ba891fd2806/volumes"
Jul 28 23:01:36.669833 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:36.669794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:01:39.600244 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:01:39.600211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:02.062387 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:02.062352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:14.404956 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:14.404919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:16.760045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:16.760004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:17.303573 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:17.303529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:23.272198 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:23.272164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:23.374420 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:23.374377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:23.562343 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:23.562259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:23.802826 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:23.802787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:24.069663 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.069631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"]
Jul 28 23:02:24.070046 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070033    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070048    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070059    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070065    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070074    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e05758-8e42-40b0-a751-0ba891fd2806" containerName="revoke-keys"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070079    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e05758-8e42-40b0-a751-0ba891fd2806" containerName="revoke-keys"
Jul 28 23:02:24.070091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070091    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" containerName="payload-processing"
Jul 28 23:02:24.070279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" containerName="payload-processing"
Jul 28 23:02:24.070279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070168    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:24.070279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070177    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="733ff29e-4dbb-4b26-a65d-96082fd4bbf4" containerName="payload-processing"
Jul 28 23:02:24.070279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.070188    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e05758-8e42-40b0-a751-0ba891fd2806" containerName="revoke-keys"
Jul 28 23:02:24.073464 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.073446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:24.076034 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.076008    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:02:24.080427 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.080402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"]
Jul 28 23:02:24.128473 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.128444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb\" (UID: \"3bebd248-f698-4179-9838-bb1872a0add8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:24.230188 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.230140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb\" (UID: \"3bebd248-f698-4179-9838-bb1872a0add8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:24.230908 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.230888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb\" (UID: \"3bebd248-f698-4179-9838-bb1872a0add8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:24.386162 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.386061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:24.526176 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:24.526144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"]
Jul 28 23:02:24.527882 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:02:24.527858    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bebd248_f698_4179_9838_bb1872a0add8.slice/crio-b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df WatchSource:0}: Error finding container b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df: Status 404 returned error can't find the container with id b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df
Jul 28 23:02:25.172304 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:25.172207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb" event={"ID":"3bebd248-f698-4179-9838-bb1872a0add8","Type":"ContainerStarted","Data":"490c0fbc02055ae14c4561201e1db3e640a43519f0bd498708d3e93864ba0d79"}
Jul 28 23:02:25.172304 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:25.172261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb" event={"ID":"3bebd248-f698-4179-9838-bb1872a0add8","Type":"ContainerStarted","Data":"b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df"}
Jul 28 23:02:25.190930 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:25.190874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb" podStartSLOduration=1.190860386 podStartE2EDuration="1.190860386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:02:25.187614621 +0000 UTC m=+3472.499853609" watchObservedRunningTime="2026-07-28 23:02:25.190860386 +0000 UTC m=+3472.503099377"
Jul 28 23:02:26.179262 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:26.179229    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bebd248-f698-4179-9838-bb1872a0add8" containerID="490c0fbc02055ae14c4561201e1db3e640a43519f0bd498708d3e93864ba0d79" exitCode=0
Jul 28 23:02:26.179671 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:26.179315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb" event={"ID":"3bebd248-f698-4179-9838-bb1872a0add8","Type":"ContainerDied","Data":"490c0fbc02055ae14c4561201e1db3e640a43519f0bd498708d3e93864ba0d79"}
Jul 28 23:02:27.322866 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:27.322840    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:27.461881 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:27.461781    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca\") pod \"3bebd248-f698-4179-9838-bb1872a0add8\" (UID: \"3bebd248-f698-4179-9838-bb1872a0add8\") "
Jul 28 23:02:27.462194 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:27.462168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3bebd248-f698-4179-9838-bb1872a0add8" (UID: "3bebd248-f698-4179-9838-bb1872a0add8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:27.562905 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:27.562867    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bebd248-f698-4179-9838-bb1872a0add8-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:28.193337 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:28.193300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb" event={"ID":"3bebd248-f698-4179-9838-bb1872a0add8","Type":"ContainerDied","Data":"b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df"}
Jul 28 23:02:28.193337 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:28.193326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"
Jul 28 23:02:28.193548 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:28.193374    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2450748ef2a62d0fbda9f008377cda9b1a457185a4633b06e9c6aa7903273df"
Jul 28 23:02:29.968268 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:29.968235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 23:02:29.968774 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:29.968518    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" podUID="56bf1725-e94b-49a3-bc22-7640d5043401" containerName="maas-api" containerID="cri-o://6b0de64d21237849ecbf365678837f4c043f5a155485f504d48c830fecb89e36" gracePeriod=30
Jul 28 23:02:29.987985 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:29.987948    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"]
Jul 28 23:02:29.993962 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:29.993937    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-908e19-29754660-snxqc"]
Jul 28 23:02:29.996761 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:29.996740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:30.132967 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.132933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:30.208055 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.208025    2563 generic.go:356] "Generic (PLEG): container finished" podID="56bf1725-e94b-49a3-bc22-7640d5043401" containerID="6b0de64d21237849ecbf365678837f4c043f5a155485f504d48c830fecb89e36" exitCode=0
Jul 28 23:02:30.208173 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.208089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" event={"ID":"56bf1725-e94b-49a3-bc22-7640d5043401","Type":"ContainerDied","Data":"6b0de64d21237849ecbf365678837f4c043f5a155485f504d48c830fecb89e36"}
Jul 28 23:02:30.208173 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.208141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w" event={"ID":"56bf1725-e94b-49a3-bc22-7640d5043401","Type":"ContainerDied","Data":"aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00"}
Jul 28 23:02:30.208173 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.208160    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aedfc5f7d53cf1e287155cb20631314516e0f7b68b870e00a3f11fcd67c38c00"
Jul 28 23:02:30.218730 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.218679    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 23:02:30.223619 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.223597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:30.290133 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.290103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls\") pod \"56bf1725-e94b-49a3-bc22-7640d5043401\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") "
Jul 28 23:02:30.290133 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.290140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca\") pod \"56bf1725-e94b-49a3-bc22-7640d5043401\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") "
Jul 28 23:02:30.290325 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.290167    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kz2x\" (UniqueName: \"kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x\") pod \"56bf1725-e94b-49a3-bc22-7640d5043401\" (UID: \"56bf1725-e94b-49a3-bc22-7640d5043401\") "
Jul 28 23:02:30.290611 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.290565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56bf1725-e94b-49a3-bc22-7640d5043401" (UID: "56bf1725-e94b-49a3-bc22-7640d5043401"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:30.292441 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.292422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56bf1725-e94b-49a3-bc22-7640d5043401" (UID: "56bf1725-e94b-49a3-bc22-7640d5043401"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 23:02:30.292513 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.292493    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x" (OuterVolumeSpecName: "kube-api-access-4kz2x") pod "56bf1725-e94b-49a3-bc22-7640d5043401" (UID: "56bf1725-e94b-49a3-bc22-7640d5043401"). InnerVolumeSpecName "kube-api-access-4kz2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:30.325333 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.325303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:30.391754 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.391722    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56bf1725-e94b-49a3-bc22-7640d5043401-maas-api-tls\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:30.391754 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.391749    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56bf1725-e94b-49a3-bc22-7640d5043401-openshift-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:30.391754 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.391760    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kz2x\" (UniqueName: \"kubernetes.io/projected/56bf1725-e94b-49a3-bc22-7640d5043401-kube-api-access-4kz2x\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:30.460428 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.460389    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"]
Jul 28 23:02:30.464656 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.464627    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-908e19-n55kb"]
Jul 28 23:02:30.776337 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:30.776302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:31.214776 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:31.214741    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"
Jul 28 23:02:31.236888 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:31.236852    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 23:02:31.244147 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:31.244123    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bebd248-f698-4179-9838-bb1872a0add8" path="/var/lib/kubelet/pods/3bebd248-f698-4179-9838-bb1872a0add8/volumes"
Jul 28 23:02:31.244416 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:31.244402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f254278-cd0e-4541-b871-6b03d862cd7a" path="/var/lib/kubelet/pods/8f254278-cd0e-4541-b871-6b03d862cd7a/volumes"
Jul 28 23:02:31.244649 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:31.244636    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-908e19-7b5b777c77-8ss2w"]
Jul 28 23:02:33.244615 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:33.244567    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56bf1725-e94b-49a3-bc22-7640d5043401" path="/var/lib/kubelet/pods/56bf1725-e94b-49a3-bc22-7640d5043401/volumes"
Jul 28 23:02:36.677476 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:36.677438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:36.741981 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:36.741938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:36.941951 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:36.941923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:37.182835 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.182803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:37.333436 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.333343    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"]
Jul 28 23:02:37.333870 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.333850    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56bf1725-e94b-49a3-bc22-7640d5043401" containerName="maas-api"
Jul 28 23:02:37.333972 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.333873    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56bf1725-e94b-49a3-bc22-7640d5043401" containerName="maas-api"
Jul 28 23:02:37.333972 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.333894    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bebd248-f698-4179-9838-bb1872a0add8" containerName="revoke-keys"
Jul 28 23:02:37.333972 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.333904    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bebd248-f698-4179-9838-bb1872a0add8" containerName="revoke-keys"
Jul 28 23:02:37.334129 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.334033    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fad2169-1db2-4d43-9b8e-b61fc9205a8e" containerName="istio-proxy"
Jul 28 23:02:37.334129 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.334049    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56bf1725-e94b-49a3-bc22-7640d5043401" containerName="maas-api"
Jul 28 23:02:37.334129 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.334060    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bebd248-f698-4179-9838-bb1872a0add8" containerName="revoke-keys"
Jul 28 23:02:37.338558 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.338536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:37.341510 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.341487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 23:02:37.342677 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.342653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:02:37.345235 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.345205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"]
Jul 28 23:02:37.462864 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.462826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h\" (UID: \"d8db001a-2b6f-4f17-b358-38cb3f8afa74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:37.564491 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.564453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h\" (UID: \"d8db001a-2b6f-4f17-b358-38cb3f8afa74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:37.565125 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.565104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h\" (UID: \"d8db001a-2b6f-4f17-b358-38cb3f8afa74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:37.651117 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.651035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:37.995812 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:37.995782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"]
Jul 28 23:02:37.997320 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:02:37.997294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8db001a_2b6f_4f17_b358_38cb3f8afa74.slice/crio-5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd WatchSource:0}: Error finding container 5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd: Status 404 returned error can't find the container with id 5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd
Jul 28 23:02:38.227698 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:38.227664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:38.256449 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:38.256378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h" event={"ID":"d8db001a-2b6f-4f17-b358-38cb3f8afa74","Type":"ContainerStarted","Data":"5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd"}
Jul 28 23:02:38.328429 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:38.328401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:39.263670 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:39.263637    2563 generic.go:356] "Generic (PLEG): container finished" podID="d8db001a-2b6f-4f17-b358-38cb3f8afa74" containerID="a638f7fb5014bbf5c6aa253e537a07e324906064b7f44e759f6a851f4180b29d" exitCode=0
Jul 28 23:02:39.264074 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:39.263728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h" event={"ID":"d8db001a-2b6f-4f17-b358-38cb3f8afa74","Type":"ContainerDied","Data":"a638f7fb5014bbf5c6aa253e537a07e324906064b7f44e759f6a851f4180b29d"}
Jul 28 23:02:40.407294 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:40.407261    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:40.490338 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:40.490305    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca\") pod \"d8db001a-2b6f-4f17-b358-38cb3f8afa74\" (UID: \"d8db001a-2b6f-4f17-b358-38cb3f8afa74\") "
Jul 28 23:02:40.490749 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:40.490717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8db001a-2b6f-4f17-b358-38cb3f8afa74" (UID: "d8db001a-2b6f-4f17-b358-38cb3f8afa74"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:40.591082 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:40.590998    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8db001a-2b6f-4f17-b358-38cb3f8afa74-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:41.277719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:41.277634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h" event={"ID":"d8db001a-2b6f-4f17-b358-38cb3f8afa74","Type":"ContainerDied","Data":"5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd"}
Jul 28 23:02:41.277719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:41.277666    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"
Jul 28 23:02:41.277719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:41.277686    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e6148d0dc693d9ac6584660c2abfbf12e9b1ced91a781752917773fa4df59bd"
Jul 28 23:02:44.332651 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.332617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:44.333792 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.333767    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"]
Jul 28 23:02:44.336322 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.336303    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3682ae-29754660-7lphv"]
Jul 28 23:02:44.395573 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.395524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:44.495873 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.495836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:44.557664 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.557619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:44.662201 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.662112    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"]
Jul 28 23:02:44.666073 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:44.666047    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3682ae-dwd2h"]
Jul 28 23:02:45.064598 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:45.064551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:45.245381 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:45.245346    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8db001a-2b6f-4f17-b358-38cb3f8afa74" path="/var/lib/kubelet/pods/d8db001a-2b6f-4f17-b358-38cb3f8afa74/volumes"
Jul 28 23:02:45.245711 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:45.245695    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b5e7e8-0df7-41b2-a543-179bcb6704e4" path="/var/lib/kubelet/pods/f4b5e7e8-0df7-41b2-a543-179bcb6704e4/volumes"
Jul 28 23:02:51.002198 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.002162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:51.100272 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.100243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:51.255956 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.255877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:51.503739 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.503689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:51.617527 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.617442    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"]
Jul 28 23:02:51.617890 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.617876    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8db001a-2b6f-4f17-b358-38cb3f8afa74" containerName="revoke-keys"
Jul 28 23:02:51.617890 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.617891    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8db001a-2b6f-4f17-b358-38cb3f8afa74" containerName="revoke-keys"
Jul 28 23:02:51.617988 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.617960    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8db001a-2b6f-4f17-b358-38cb3f8afa74" containerName="revoke-keys"
Jul 28 23:02:51.621223 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.621208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:51.623896 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.623870    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 23:02:51.624186 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.624165    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 23:02:51.629243 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.628998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"]
Jul 28 23:02:51.686943 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.686911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7\" (UID: \"efd21b32-0b8b-45ed-9239-3f3669bb1660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:51.787859 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.787824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7\" (UID: \"efd21b32-0b8b-45ed-9239-3f3669bb1660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:51.788427 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.788407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7\" (UID: \"efd21b32-0b8b-45ed-9239-3f3669bb1660\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:51.933535 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:51.933504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:52.073755 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:52.073728    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"]
Jul 28 23:02:52.075414 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:02:52.075374    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd21b32_0b8b_45ed_9239_3f3669bb1660.slice/crio-5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8 WatchSource:0}: Error finding container 5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8: Status 404 returned error can't find the container with id 5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8
Jul 28 23:02:52.348717 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:52.348677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7" event={"ID":"efd21b32-0b8b-45ed-9239-3f3669bb1660","Type":"ContainerStarted","Data":"5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8"}
Jul 28 23:02:53.357121 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:53.357086    2563 generic.go:356] "Generic (PLEG): container finished" podID="efd21b32-0b8b-45ed-9239-3f3669bb1660" containerID="2be2138409be04698678ed1565c9448f146d1c910d8bd46f8320456e9311df5a" exitCode=0
Jul 28 23:02:53.357542 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:53.357170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7" event={"ID":"efd21b32-0b8b-45ed-9239-3f3669bb1660","Type":"ContainerDied","Data":"2be2138409be04698678ed1565c9448f146d1c910d8bd46f8320456e9311df5a"}
Jul 28 23:02:54.498465 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:54.498443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:54.611926 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:54.611887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca\") pod \"efd21b32-0b8b-45ed-9239-3f3669bb1660\" (UID: \"efd21b32-0b8b-45ed-9239-3f3669bb1660\") "
Jul 28 23:02:54.612261 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:54.612238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efd21b32-0b8b-45ed-9239-3f3669bb1660" (UID: "efd21b32-0b8b-45ed-9239-3f3669bb1660"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:54.713517 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:54.713479    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efd21b32-0b8b-45ed-9239-3f3669bb1660-maas-api-service-ca\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:55.370701 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:55.370664    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"
Jul 28 23:02:55.370701 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:55.370690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7" event={"ID":"efd21b32-0b8b-45ed-9239-3f3669bb1660","Type":"ContainerDied","Data":"5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8"}
Jul 28 23:02:55.370947 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:55.370739    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b57616964f1f0ddd7b773dfe2b35dbabf04b2e6f0ff8dc9d64d68886a5ec1f8"
Jul 28 23:02:56.816158 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.816111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:56.818128 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.818102    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"]
Jul 28 23:02:56.820489 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.820467    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-aa2de7-29754660-tvnz9"]
Jul 28 23:02:56.889569 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.889538    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 23:02:56.889887 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.889835    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" podUID="5742d2b8-28d7-410e-be58-6a994432038b" containerName="payload-processing" containerID="cri-o://7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac" gracePeriod=30
Jul 28 23:02:56.913110 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.913085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:56.977449 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:56.977415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:57.108136 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.108038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:57.111956 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.111922    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"]
Jul 28 23:02:57.116010 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.115984    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-aa2de7-gvhr7"]
Jul 28 23:02:57.143213 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.143189    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 23:02:57.236715 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.236687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hh6j\" (UniqueName: \"kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j\") pod \"5742d2b8-28d7-410e-be58-6a994432038b\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") "
Jul 28 23:02:57.236885 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.236758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume\") pod \"5742d2b8-28d7-410e-be58-6a994432038b\" (UID: \"5742d2b8-28d7-410e-be58-6a994432038b\") "
Jul 28 23:02:57.237165 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.237145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5742d2b8-28d7-410e-be58-6a994432038b" (UID: "5742d2b8-28d7-410e-be58-6a994432038b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:57.238930 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.238910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j" (OuterVolumeSpecName: "kube-api-access-2hh6j") pod "5742d2b8-28d7-410e-be58-6a994432038b" (UID: "5742d2b8-28d7-410e-be58-6a994432038b"). InnerVolumeSpecName "kube-api-access-2hh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:57.244818 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.244792    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efd21b32-0b8b-45ed-9239-3f3669bb1660" path="/var/lib/kubelet/pods/efd21b32-0b8b-45ed-9239-3f3669bb1660/volumes"
Jul 28 23:02:57.245099 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.245076    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c2780f-ad01-410e-b977-100d79fcecd1" path="/var/lib/kubelet/pods/f7c2780f-ad01-410e-b977-100d79fcecd1/volumes"
Jul 28 23:02:57.337379 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.337354    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hh6j\" (UniqueName: \"kubernetes.io/projected/5742d2b8-28d7-410e-be58-6a994432038b-kube-api-access-2hh6j\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:57.337379 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.337377    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5742d2b8-28d7-410e-be58-6a994432038b-plugins-config-volume\") on node \"ip-10-0-133-142.ec2.internal\" DevicePath \"\""
Jul 28 23:02:57.384489 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.384412    2563 generic.go:356] "Generic (PLEG): container finished" podID="5742d2b8-28d7-410e-be58-6a994432038b" containerID="7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac" exitCode=0
Jul 28 23:02:57.384489 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.384452    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"
Jul 28 23:02:57.384683 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.384507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" event={"ID":"5742d2b8-28d7-410e-be58-6a994432038b","Type":"ContainerDied","Data":"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"}
Jul 28 23:02:57.384683 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.384569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh" event={"ID":"5742d2b8-28d7-410e-be58-6a994432038b","Type":"ContainerDied","Data":"1c5a8cd1fcbb1206632f4014b80b28ec3214736e4f8d974acaf9e574bc4e68a2"}
Jul 28 23:02:57.384683 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.384613    2563 scope.go:117] "RemoveContainer" containerID="7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"
Jul 28 23:02:57.394180 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.394159    2563 scope.go:117] "RemoveContainer" containerID="7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"
Jul 28 23:02:57.394455 ip-10-0-133-142 kubenswrapper[2563]: E0728 23:02:57.394429    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac\": container with ID starting with 7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac not found: ID does not exist" containerID="7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"
Jul 28 23:02:57.394513 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.394457    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac"} err="failed to get container status \"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac\": rpc error: code = NotFound desc = could not find container \"7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac\": container with ID starting with 7618bee84f454fcb5503be8f245b97bc154bed4c011a850d355f925d16a26dac not found: ID does not exist"
Jul 28 23:02:57.401391 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.401369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 23:02:57.405002 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.404982    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-aa2de7-7c9c9cb466-q5crh"]
Jul 28 23:02:57.479004 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:57.478949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:02:59.243836 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:02:59.243803    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5742d2b8-28d7-410e-be58-6a994432038b" path="/var/lib/kubelet/pods/5742d2b8-28d7-410e-be58-6a994432038b/volumes"
Jul 28 23:03:03.383910 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:03.383878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:03.440317 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:03.440286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:03.678639 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:03.678494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:03.888807 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:03.888773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:04.324413 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:04.324384    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9b58cd76-rxpfs_e5dc20f0-1a36-4edb-960a-feb29f3896e0/authorino/0.log"
Jul 28 23:03:10.474660 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:10.472691    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jgpvj_df50d724-eb3f-42e7-b34b-40e2d47893ab/manager/0.log"
Jul 28 23:03:10.876239 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:10.876157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-xtpjl_30cc1e07-6a14-42af-8bff-f59dd44207e6/copy-manifests/0.log"
Jul 28 23:03:10.883195 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:10.883172    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-xtpjl_30cc1e07-6a14-42af-8bff-f59dd44207e6/manager/0.log"
Jul 28 23:03:11.346338 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:11.346312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754630-dghvr_d20ef818-58ce-46f7-9166-222b275f5c19/cleanup/0.log"
Jul 28 23:03:11.482681 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:11.482655    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754645-6x6cv_4ad71f50-b30c-4180-9f03-12e5e6486df0/cleanup/0.log"
Jul 28 23:03:11.604106 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:11.604015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754660-wdcdx_f098574f-3f4b-41de-acf9-56bda51cdd56/cleanup/0.log"
Jul 28 23:03:12.524485 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.524457    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/util/0.log"
Jul 28 23:03:12.531692 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.531670    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/pull/0.log"
Jul 28 23:03:12.538520 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.538504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/extract/0.log"
Jul 28 23:03:12.653129 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.653097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/util/0.log"
Jul 28 23:03:12.659617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.659597    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/pull/0.log"
Jul 28 23:03:12.666176 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.666158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/extract/0.log"
Jul 28 23:03:12.786040 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.785958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/util/0.log"
Jul 28 23:03:12.793181 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.793160    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/pull/0.log"
Jul 28 23:03:12.800120 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.800101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/extract/0.log"
Jul 28 23:03:12.918675 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.918646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/util/0.log"
Jul 28 23:03:12.925808 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.925782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/pull/0.log"
Jul 28 23:03:12.932739 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:12.932717    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/extract/0.log"
Jul 28 23:03:13.059014 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:13.058939    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9b58cd76-rxpfs_e5dc20f0-1a36-4edb-960a-feb29f3896e0/authorino/0.log"
Jul 28 23:03:13.410474 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:13.410403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jtw2v_8db188ef-61fc-47b2-8ee5-6705385675be/kuadrant-console-plugin/0.log"
Jul 28 23:03:14.624534 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:14.624506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9899fcb89-7c7qn_cee909b3-f3f8-45b8-8449-62b1f4817cab/kube-auth-proxy/0.log"
Jul 28 23:03:14.997164 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:14.997136    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 23:03:15.130534 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:15.130504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584cc85f59-5zstr_366197b2-1ac6-4901-8c66-20a5bf6f6e2b/router/0.log"
Jul 28 23:03:15.615449 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:15.615420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-zblmr_71ae63b0-5624-4263-bc51-9a6c150049f1/main/0.log"
Jul 28 23:03:15.864322 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:15.864277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs47sg_91cae49c-0658-440a-8d4e-add5dec9a87c/main/0.log"
Jul 28 23:03:21.691175 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691138    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8jld/must-gather-mf47t"]
Jul 28 23:03:21.691617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691528    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efd21b32-0b8b-45ed-9239-3f3669bb1660" containerName="revoke-keys"
Jul 28 23:03:21.691617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691539    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="efd21b32-0b8b-45ed-9239-3f3669bb1660" containerName="revoke-keys"
Jul 28 23:03:21.691617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691561    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5742d2b8-28d7-410e-be58-6a994432038b" containerName="payload-processing"
Jul 28 23:03:21.691617 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691567    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5742d2b8-28d7-410e-be58-6a994432038b" containerName="payload-processing"
Jul 28 23:03:21.691835 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5742d2b8-28d7-410e-be58-6a994432038b" containerName="payload-processing"
Jul 28 23:03:21.691835 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.691672    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="efd21b32-0b8b-45ed-9239-3f3669bb1660" containerName="revoke-keys"
Jul 28 23:03:21.695191 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.695167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.697911 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.697887    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8jld\"/\"kube-root-ca.crt\""
Jul 28 23:03:21.698025 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.697959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8jld\"/\"openshift-service-ca.crt\""
Jul 28 23:03:21.699206 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.699190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x8jld\"/\"default-dockercfg-jw6hm\""
Jul 28 23:03:21.705911 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.705890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:21.707499 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.707478    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/must-gather-mf47t"]
Jul 28 23:03:21.803099 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.803058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log" limit=1024
Jul 28 23:03:21.866133 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.866102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dad6ed06-1dba-404b-93ee-a88bc453d892-must-gather-output\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.866320 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.866161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kzz4\" (UniqueName: \"kubernetes.io/projected/dad6ed06-1dba-404b-93ee-a88bc453d892-kube-api-access-6kzz4\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.967535 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.967431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dad6ed06-1dba-404b-93ee-a88bc453d892-must-gather-output\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.967535 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.967508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kzz4\" (UniqueName: \"kubernetes.io/projected/dad6ed06-1dba-404b-93ee-a88bc453d892-kube-api-access-6kzz4\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.967821 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.967801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dad6ed06-1dba-404b-93ee-a88bc453d892-must-gather-output\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:21.976482 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:21.976448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kzz4\" (UniqueName: \"kubernetes.io/projected/dad6ed06-1dba-404b-93ee-a88bc453d892-kube-api-access-6kzz4\") pod \"must-gather-mf47t\" (UID: \"dad6ed06-1dba-404b-93ee-a88bc453d892\") " pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:22.005385 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:22.005353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/must-gather-mf47t"
Jul 28 23:03:22.143687 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:22.143658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/must-gather-mf47t"]
Jul 28 23:03:22.145349 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:03:22.145322    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddad6ed06_1dba_404b_93ee_a88bc453d892.slice/crio-16a53902e3566a839c5792e11ac045a1d2f0cf85b401f07155fc5fe7309d4119 WatchSource:0}: Error finding container 16a53902e3566a839c5792e11ac045a1d2f0cf85b401f07155fc5fe7309d4119: Status 404 returned error can't find the container with id 16a53902e3566a839c5792e11ac045a1d2f0cf85b401f07155fc5fe7309d4119
Jul 28 23:03:22.147667 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:22.147647    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 23:03:22.554791 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:22.554752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/must-gather-mf47t" event={"ID":"dad6ed06-1dba-404b-93ee-a88bc453d892","Type":"ContainerStarted","Data":"16a53902e3566a839c5792e11ac045a1d2f0cf85b401f07155fc5fe7309d4119"}
Jul 28 23:03:23.569930 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:23.569882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/must-gather-mf47t" event={"ID":"dad6ed06-1dba-404b-93ee-a88bc453d892","Type":"ContainerStarted","Data":"6a7d6a2c4094c6dcde4a51581daa30f2166777c9e7afb985dc663c932842a580"}
Jul 28 23:03:23.570428 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:23.569949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/must-gather-mf47t" event={"ID":"dad6ed06-1dba-404b-93ee-a88bc453d892","Type":"ContainerStarted","Data":"40ae898bc4008c5c283381fa7b8fc07dc83956193e10ea3d3995ba7f29ad9c90"}
Jul 28 23:03:23.585903 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:23.585792    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x8jld/must-gather-mf47t" podStartSLOduration=1.915763427 podStartE2EDuration="2.5857716s" totalImagesPullingTime="670.008173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 23:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:03:23.584923151 +0000 UTC m=+3530.897162143" watchObservedRunningTime="2026-07-28 23:03:23.5857716 +0000 UTC m=+3530.898010592"
Jul 28 23:03:24.402560 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:24.402526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d2tsm_05546884-8e52-4881-9871-8860567436dd/global-pull-secret-syncer/0.log"
Jul 28 23:03:24.497964 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:24.497935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5j24t_0dd850ee-d2de-474b-b301-2f52ce94c782/konnectivity-agent/0.log"
Jul 28 23:03:24.621543 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:24.621509    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-142.ec2.internal_f12b46d1950955bc6884ff5ac3c8c404/haproxy/0.log"
Jul 28 23:03:28.981385 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:28.981353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/extract/0.log"
Jul 28 23:03:29.009481 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.009450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/util/0.log"
Jul 28 23:03:29.034006 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.033978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxlrr_5267aaea-2a77-442a-8aaa-3ee7ea1f1870/pull/0.log"
Jul 28 23:03:29.064452 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.064424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/extract/0.log"
Jul 28 23:03:29.092596 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.092555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/util/0.log"
Jul 28 23:03:29.118064 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.117987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07qgdb_2e8bff7b-abd6-489c-8277-48ef22b22f7a/pull/0.log"
Jul 28 23:03:29.162488 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.162457    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/extract/0.log"
Jul 28 23:03:29.188551 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.188517    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/util/0.log"
Jul 28 23:03:29.213319 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.213278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737bzbz_f053b79a-34d7-4845-8d98-166ca5041d44/pull/0.log"
Jul 28 23:03:29.244362 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.244282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/extract/0.log"
Jul 28 23:03:29.271335 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.271299    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/util/0.log"
Jul 28 23:03:29.298060 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.298020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcq8g_e0a92178-f2e2-49c3-a702-3a941b83f222/pull/0.log"
Jul 28 23:03:29.842257 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.842217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9b58cd76-rxpfs_e5dc20f0-1a36-4edb-960a-feb29f3896e0/authorino/0.log"
Jul 28 23:03:29.929219 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:29.929184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jtw2v_8db188ef-61fc-47b2-8ee5-6705385675be/kuadrant-console-plugin/0.log"
Jul 28 23:03:32.073146 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.073098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-xrdmd_6f7da923-24db-4d5b-80e6-68ed4b46783c/cluster-monitoring-operator/0.log"
Jul 28 23:03:32.104508 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.104479    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s79v8_9c14d07d-0dc1-4a8a-b5ea-f46389f71db2/kube-state-metrics/0.log"
Jul 28 23:03:32.127964 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.127924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s79v8_9c14d07d-0dc1-4a8a-b5ea-f46389f71db2/kube-rbac-proxy-main/0.log"
Jul 28 23:03:32.157923 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.157884    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s79v8_9c14d07d-0dc1-4a8a-b5ea-f46389f71db2/kube-rbac-proxy-self/0.log"
Jul 28 23:03:32.218205 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.218169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-rz6c8_bb73e13a-9cc2-4a99-ba4e-ed0527cdd5a2/monitoring-plugin/0.log"
Jul 28 23:03:32.409970 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.409895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbj4z_62320737-29a9-4c8e-a474-604c406acd98/node-exporter/0.log"
Jul 28 23:03:32.435810 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.435777    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbj4z_62320737-29a9-4c8e-a474-604c406acd98/kube-rbac-proxy/0.log"
Jul 28 23:03:32.460089 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.460061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbj4z_62320737-29a9-4c8e-a474-604c406acd98/init-textfile/0.log"
Jul 28 23:03:32.490719 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.490694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fbrnr_71cc8dc8-8594-4a28-945e-8474502e4a17/kube-rbac-proxy-main/0.log"
Jul 28 23:03:32.515748 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.515722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fbrnr_71cc8dc8-8594-4a28-945e-8474502e4a17/kube-rbac-proxy-self/0.log"
Jul 28 23:03:32.539487 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.539451    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-fbrnr_71cc8dc8-8594-4a28-945e-8474502e4a17/openshift-state-metrics/0.log"
Jul 28 23:03:32.833674 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.833621    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865b9c8bc-c2cfj_e8bb8326-b9d4-44e8-9014-0c0ffa6638bb/telemeter-client/0.log"
Jul 28 23:03:32.858971 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.858938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865b9c8bc-c2cfj_e8bb8326-b9d4-44e8-9014-0c0ffa6638bb/reload/0.log"
Jul 28 23:03:32.882223 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.882191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865b9c8bc-c2cfj_e8bb8326-b9d4-44e8-9014-0c0ffa6638bb/kube-rbac-proxy/0.log"
Jul 28 23:03:32.926894 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.926864    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/thanos-query/0.log"
Jul 28 23:03:32.962811 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.962723    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/kube-rbac-proxy-web/0.log"
Jul 28 23:03:32.989325 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:32.989296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/kube-rbac-proxy/0.log"
Jul 28 23:03:33.012299 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:33.012255    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/prom-label-proxy/0.log"
Jul 28 23:03:33.036794 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:33.036726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/kube-rbac-proxy-rules/0.log"
Jul 28 23:03:33.061911 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:33.061864    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84cd445d4c-7jwrh_8a4f7906-6a1d-4e29-8d0f-bf347bdb3d46/kube-rbac-proxy-metrics/0.log"
Jul 28 23:03:34.241906 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.241874    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-kgrsx_ac72fe00-deb7-48d6-9f44-1ff5bb582af0/networking-console-plugin/0.log"
Jul 28 23:03:34.634795 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.634695    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"]
Jul 28 23:03:34.640488 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.640455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.645777 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.645752    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"]
Jul 28 23:03:34.737279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.736970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-proc\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.737279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.737045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-lib-modules\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.737279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.737085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb46p\" (UniqueName: \"kubernetes.io/projected/7ea26033-879b-4b3e-b814-c54194a70f09-kube-api-access-fb46p\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.737279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.737143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-podres\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.737279 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.737172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-sys\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.838401 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.838241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-lib-modules\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.838957 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.838923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-lib-modules\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839074 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.838971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb46p\" (UniqueName: \"kubernetes.io/projected/7ea26033-879b-4b3e-b814-c54194a70f09-kube-api-access-fb46p\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839150 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-podres\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839308 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-podres\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839373 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-sys\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839510 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-sys\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839600 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-proc\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.839724 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.839703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ea26033-879b-4b3e-b814-c54194a70f09-proc\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.847245 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.847197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb46p\" (UniqueName: \"kubernetes.io/projected/7ea26033-879b-4b3e-b814-c54194a70f09-kube-api-access-fb46p\") pod \"perf-node-gather-daemonset-z75mg\" (UID: \"7ea26033-879b-4b3e-b814-c54194a70f09\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:34.907375 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.907292    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/1.log"
Jul 28 23:03:34.912887 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.912861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6gfkm_14ac364f-bac5-4c91-b6f0-01e23159abbc/console-operator/2.log"
Jul 28 23:03:34.960804 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:34.960766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:35.153001 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:35.152965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"]
Jul 28 23:03:35.156376 ip-10-0-133-142 kubenswrapper[2563]: W0728 23:03:35.156332    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ea26033_879b_4b3e_b814_c54194a70f09.slice/crio-76624d07a90338b1fbd604ca886ed212679fd5647d4f6eb82d1ad159094f8062 WatchSource:0}: Error finding container 76624d07a90338b1fbd604ca886ed212679fd5647d4f6eb82d1ad159094f8062: Status 404 returned error can't find the container with id 76624d07a90338b1fbd604ca886ed212679fd5647d4f6eb82d1ad159094f8062
Jul 28 23:03:35.697018 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:35.696974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg" event={"ID":"7ea26033-879b-4b3e-b814-c54194a70f09","Type":"ContainerStarted","Data":"f50cc3e27cb3a3be5aa6fdfdf0023f07fee1f554c152256543d8a9d380ddf7d5"}
Jul 28 23:03:35.697516 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:35.697050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg" event={"ID":"7ea26033-879b-4b3e-b814-c54194a70f09","Type":"ContainerStarted","Data":"76624d07a90338b1fbd604ca886ed212679fd5647d4f6eb82d1ad159094f8062"}
Jul 28 23:03:35.697516 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:35.697220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:35.715395 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:35.715339    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg" podStartSLOduration=1.715318768 podStartE2EDuration="1.715318768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 23:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:03:35.712281949 +0000 UTC m=+3543.024520941" watchObservedRunningTime="2026-07-28 23:03:35.715318768 +0000 UTC m=+3543.027557761"
Jul 28 23:03:36.060249 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:36.060142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-6rtcq_1d2ca956-c72a-4e5b-82d4-b164745eac61/volume-data-source-validator/0.log"
Jul 28 23:03:37.045487 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:37.045453    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p7fl_d3101ed0-7847-42ba-82ff-5786a9b34859/dns/0.log"
Jul 28 23:03:37.078003 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:37.077977    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p7fl_d3101ed0-7847-42ba-82ff-5786a9b34859/kube-rbac-proxy/0.log"
Jul 28 23:03:37.228772 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:37.228740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kvwrj_a87dbd61-29cd-42e8-8ef8-3cfd9858beea/dns-node-resolver/0.log"
Jul 28 23:03:37.801649 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:37.801619    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gn6w4_034e0649-6338-4b99-a163-c35353acaa65/node-ca/0.log"
Jul 28 23:03:38.951117 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:38.951092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9899fcb89-7c7qn_cee909b3-f3f8-45b8-8449-62b1f4817cab/kube-auth-proxy/0.log"
Jul 28 23:03:39.103649 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:39.103621    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 23:03:39.129186 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:39.129163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584cc85f59-5zstr_366197b2-1ac6-4901-8c66-20a5bf6f6e2b/router/0.log"
Jul 28 23:03:39.925748 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:39.925720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfl92_b1409118-44cf-4a04-b3a5-e1ef605d4e14/serve-healthcheck-canary/0.log"
Jul 28 23:03:40.450572 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:40.450534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kxgrd_00847bff-28a3-4991-a974-983fe2e6aac1/insights-operator/0.log"
Jul 28 23:03:40.451829 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:40.451806    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-kxgrd_00847bff-28a3-4991-a974-983fe2e6aac1/insights-operator/1.log"
Jul 28 23:03:40.620747 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:40.620716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6vw6_c9eea590-a4d6-442b-b5a5-1b08df20248e/kube-rbac-proxy/0.log"
Jul 28 23:03:40.644282 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:40.644251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6vw6_c9eea590-a4d6-442b-b5a5-1b08df20248e/exporter/0.log"
Jul 28 23:03:40.668091 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:40.668061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6vw6_c9eea590-a4d6-442b-b5a5-1b08df20248e/extractor/0.log"
Jul 28 23:03:41.719298 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:41.719260    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-z75mg"
Jul 28 23:03:43.437496 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:43.437457    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jgpvj_df50d724-eb3f-42e7-b34b-40e2d47893ab/manager/0.log"
Jul 28 23:03:43.670493 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:43.670463    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-xtpjl_30cc1e07-6a14-42af-8bff-f59dd44207e6/manager/0.log"
Jul 28 23:03:43.694555 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:43.694525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-xtpjl_30cc1e07-6a14-42af-8bff-f59dd44207e6/copy-manifests/0.log"
Jul 28 23:03:45.105167 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:45.105142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9899fcb89-7c7qn_cee909b3-f3f8-45b8-8449-62b1f4817cab/kube-auth-proxy/0.log"
Jul 28 23:03:45.131618 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:45.131571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75cf9697f-zfljd_4450d5de-5944-4ebd-b6ca-48c604d261c2/manager/0.log"
Jul 28 23:03:45.216893 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:45.216857    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 23:03:45.237634 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:45.237596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584cc85f59-5zstr_366197b2-1ac6-4901-8c66-20a5bf6f6e2b/router/0.log"
Jul 28 23:03:46.842616 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:46.842489    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9899fcb89-7c7qn_cee909b3-f3f8-45b8-8449-62b1f4817cab/kube-auth-proxy/0.log"
Jul 28 23:03:46.963377 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:46.963342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4lcq_336b96bd-cd8e-41bf-b005-0119b3def24c/payload-processing/0.log"
Jul 28 23:03:46.978632 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:46.978601    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-584cc85f59-5zstr_366197b2-1ac6-4901-8c66-20a5bf6f6e2b/router/0.log"
Jul 28 23:03:50.209342 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:50.209308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mk5g4_b0557595-9f56-4170-b49f-6787b40f702d/migrator/0.log"
Jul 28 23:03:50.232422 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:50.232387    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mk5g4_b0557595-9f56-4170-b49f-6787b40f702d/graceful-termination/0.log"
Jul 28 23:03:50.575885 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:50.575803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g_c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40/kube-storage-version-migrator-operator/1.log"
Jul 28 23:03:50.576882 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:50.576851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lvj8g_c5bd60aa-dc04-4bf5-97d2-b9a7693c4d40/kube-storage-version-migrator-operator/0.log"
Jul 28 23:03:51.716620 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.716533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/kube-multus-additional-cni-plugins/0.log"
Jul 28 23:03:51.740659 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.740635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/egress-router-binary-copy/0.log"
Jul 28 23:03:51.763109 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.763087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/cni-plugins/0.log"
Jul 28 23:03:51.788268 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.788245    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/bond-cni-plugin/0.log"
Jul 28 23:03:51.809970 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.809950    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/routeoverride-cni/0.log"
Jul 28 23:03:51.831356 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.831333    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/whereabouts-cni-bincopy/0.log"
Jul 28 23:03:51.854242 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:51.854224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4nw82_8606d73a-c2af-4cf8-b66a-09e29cd21571/whereabouts-cni/0.log"
Jul 28 23:03:52.109045 ip-10-0-133-142 kubenswrapper[2563]: I0728 23:03:52.108960    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-phxgz_7d18691c-7b0b-4583-bd94-4b5f0f9e2e4f/kube-multus/0.log"