Jul 06 19:05:27.453217 ip-10-0-134-25 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:05:27.846010 ip-10-0-134-25 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:27.846010 ip-10-0-134-25 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:05:27.846010 ip-10-0-134-25 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:27.846010 ip-10-0-134-25 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:05:27.846010 ip-10-0-134-25 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:27.846714 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.846081    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:05:27.852489 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852468    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.852489 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852488    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852493    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852497    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852500    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852503    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852507    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852511    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852515    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852518    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852521    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852525    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852528    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852531    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852541    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852546    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852551    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852555    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852558    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852561    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852565    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.852571 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852568    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852571    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852574    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852577    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852580    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852584    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852587    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852590    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852593    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852596    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852599    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852602    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852604    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852607    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852610    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852613    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852616    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852619    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852621    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852624    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.853224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852628    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852631    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852633    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852636    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852639    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852642    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852645    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852648    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852650    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852653    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852656    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852659    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852662    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852664    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852668    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852671    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852674    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852677    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852679    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852682    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.854041 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852685    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852689    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852691    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852694    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852697    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852699    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852702    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852705    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852708    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852710    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852713    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852716    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852718    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852721    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852724    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852726    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852729    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852732    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852735    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.854586 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852781    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852836    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852843    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852848    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852853    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852859    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852864    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852870    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852875    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852880    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852886    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852891    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852896    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852901    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.852911    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.853836    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.853845    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.853854    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.855083 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.853860    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.857069 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857053    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.857069 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857068    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857073    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857077    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857080    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857083    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857093    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857097    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857099    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857102    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857105    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857108    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857111    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857114    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857116    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857119    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857122    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857125    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857127    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857130    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857133    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.857137 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857136    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857138    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857141    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857144    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857147    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857150    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857153    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857160    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857163    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857165    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857168    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857171    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857174    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857176    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857179    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857181    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857184    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857187    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857189    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.857703 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857192    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857196    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857200    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857203    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857206    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857208    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857211    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857214    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857216    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857219    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857221    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857224    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857228    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857232    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857235    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857239    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857242    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857245    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857248    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.858224 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857251    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857254    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857256    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857259    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857262    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857272    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857274    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857277    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857280    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857283    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857285    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857288    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857291    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857294    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857296    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857299    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857302    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857305    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857307    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857310    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.858731 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857313    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857316    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857319    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857321    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857324    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857327    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857330    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857333    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857338    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857341    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857347    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857351    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857354    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857358    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857361    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857364    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857367    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857370    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857380    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857383    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.859266 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857860    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857866    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857870    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857873    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857876    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857878    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857881    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857884    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857887    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857889    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857892    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857896    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857899    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857901    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857904    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857907    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857910    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857912    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857915    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857918    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.859787 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857921    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857924    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857927    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857930    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857932    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857935    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857938    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857940    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857943    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857946    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857949    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857952    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857954    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857957    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857960    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857962    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857965    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857968    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857971    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857973    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.860320 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857976    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857979    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857981    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857984    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857987    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857990    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857992    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857995    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.857998    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858000    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858021    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858024    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858027    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858030    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858032    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858036    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858039    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858041    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858044    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858047    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.860812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858050    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858053    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858056    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858060    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858063    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858066    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858069    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858071    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858074    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858077    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858080    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858082    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858085    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858088    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858091    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858094    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858097    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858100    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858103    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858105    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.861339 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858108    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858113    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858116    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858120    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858123    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858125    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858128    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858133    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858137    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858141    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858144    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858147    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858150    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858152    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858155    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858158    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858166    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858168    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858173    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.861859 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858251    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858268    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858275    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858279    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858284    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858287    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858292    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858296    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858300    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858303    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858307    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858311    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858314    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858317    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858320    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858323    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858327    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858330    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858336    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858339    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858342    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858346    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858349    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858353    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:05:27.862372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858356    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858360    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858363    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858366    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858369    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858372    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858376    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858380    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858389    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858392    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858395    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858398    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858401    2559 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858404    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858408    2559 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858412    2559 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858415    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858419    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858422    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858426    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858429    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858432    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858435    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858438    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858441    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:05:27.863010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858447    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858450    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858453    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858456    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858459    2559 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858463    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858467    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858470    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858473    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858476    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858479    2559 flags.go:64] FLAG: --help="false"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858482    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858486    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858489    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858493    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858506    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858511    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858514    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858517    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858520    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858523    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858526    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858529    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858532    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:05:27.863718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858536    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858539    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858542    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858545    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858548    2559 flags.go:64] FLAG: --lock-file=""
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858551    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858554    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858557    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858565    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858568    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858571    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858574    2559 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858577    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858580    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858583    2559 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858586    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858591    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858594    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858599    2559 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858602    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858606    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858609    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858612    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858616    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858620    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:05:27.864370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858623    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858631    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858634    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858637    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858641    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858644    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858650    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858653    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858656    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858660    2559 flags.go:64] FLAG: --port="10250"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858663    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858666    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d9fb2a6cf9278be"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858669    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858672    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858675    2559 flags.go:64] FLAG: --register-node="true"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858679    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858684    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858687    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858690    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858693    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858697    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858700    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858704    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858707    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858710    2559 flags.go:64] FLAG: --runonce="false"
Jul 06 19:05:27.865027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858713    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858716    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858720    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858723    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858728    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858731    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858738    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858742    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858745    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858748    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858751    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858754    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858757    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858761    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858764    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858783    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858786    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858789    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858797    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858800    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858803    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858807    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858810    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858814    2559 flags.go:64] FLAG: --v="2"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858823    2559 flags.go:64] FLAG: --version="false"
Jul 06 19:05:27.865681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858828    2559 flags.go:64] FLAG: --vmodule=""
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858831    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.858835    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858963    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858967    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858970    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858974    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858977    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858979    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858982    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858985    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858989    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858992    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858995    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.858998    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859016    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859019    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859022    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859025    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859028    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.866413 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859030    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859033    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859036    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859039    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859041    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859044    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859047    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859050    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859053    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859055    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859060    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859062    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859067    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859071    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859075    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859078    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859081    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859084    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859087    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.867192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859089    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859092    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859095    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859098    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859103    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859106    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859109    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859112    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859115    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859118    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859120    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859123    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859126    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859129    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859131    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859134    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859137    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859141    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859145    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.868147 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859148    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859151    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859154    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859157    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859162    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859165    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859168    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859170    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859173    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859176    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859179    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859181    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859184    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859187    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859189    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859192    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859195    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859199    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859202    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859205    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.868996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859208    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859211    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859214    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859217    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859220    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859223    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859227    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859231    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859235    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859238    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859241    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859244    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859247    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859250    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859253    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859256    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859260    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859263    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859266    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859270    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.869956 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859273    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859275    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859278    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.859281    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.860330    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.869708    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.869732    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.869761    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.869776    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869867    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869875    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869881    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869886    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869891    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869897    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.870938 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869902    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869906    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869911    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869915    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869920    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869925    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869929    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869934    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869938    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869943    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869947    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869953    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869958    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869963    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869967    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869971    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869975    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869979    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869984    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869988    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.871547 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869993    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.869998    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870024    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870032    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870037    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870041    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870046    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870050    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870055    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870059    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870064    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870071    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870079    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870084    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870089    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870094    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870099    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870104    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870108    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.872148 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870113    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870118    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870122    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870127    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870131    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870137    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870141    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870146    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870151    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870155    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870160    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870165    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870170    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870175    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870179    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870184    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870188    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870196    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870202    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.872964 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870207    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870212    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870217    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870222    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870227    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870232    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870236    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870242    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870247    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870252    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870256    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870261    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870265    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870269    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870274    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870279    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870283    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870288    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870292    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870296    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.873958 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870300    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870305    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870310    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870315    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870319    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870324    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870328    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870333    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870337    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870342    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870346    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870351    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870356    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870360    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870364    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.874527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.870373    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870575    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870583    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870588    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870593    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870598    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870603    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870609    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870615    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870619    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870624    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870628    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870633    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870638    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870643    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870647    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870651    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870656    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870660    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870665    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.875084 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870669    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870673    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870678    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870682    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870687    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870691    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870696    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870700    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870705    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870709    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870714    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870718    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870723    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870727    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870732    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870736    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870740    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870744    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870749    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870753    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.875651 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870758    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870762    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870767    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870771    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870775    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870780    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870784    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870789    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870793    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870797    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870802    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870807    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870811    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870816    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870820    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870825    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870829    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870834    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870838    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.876192 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870842    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870847    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870851    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870855    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870860    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870864    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870868    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870872    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870878    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870883    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870887    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870891    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870897    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870901    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870906    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870910    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870915    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870922    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870929    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.876784 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870934    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870939    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870944    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870948    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870953    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870958    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870963    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870968    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870973    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870979    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870984    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870989    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870993    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.870997    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871018    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871023    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871027    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871032    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871036    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871041    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.877440 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871045    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:27.871049    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.871058    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.871247    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.874604    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.876343    2559 server.go:1019] "Starting client certificate rotation"
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.876453    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:27.877987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.876493    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:27.878895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.878876    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:27.880621 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.880600    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:27.890516 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.890496    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:05:27.893271 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.893254    2559 log.go:25] "Validated CRI v1 image API"
Jul 06 19:05:27.894100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.894081    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:05:27.898594 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.898564    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7cbbe551-8cb6-4a15-80a5-2dbfc19911cd:/dev/nvme0n1p3 cad01a87-c7a3-420e-ab47-71c38557e89c:/dev/nvme0n1p4]
Jul 06 19:05:27.898681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.898590    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:05:27.903854 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.903727    2559 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:27.902495592 +0000 UTC m=+0.334753411 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3049554 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbec39c1c79c0b279e360fd852716 SystemUUID:ec2bbec3-9c1c-79c0-b279-e360fd852716 BootID:b21e86e4-63bd-4b06-a70a-1110ebbb8803 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:f2:84:b7:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:f2:84:b7:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:45:e6:a1:fe:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:05:27.903854 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.903846    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:05:27.903984 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.903938    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:05:27.907484 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.907456    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:05:27.907650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.907488    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:05:27.908050 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.908032    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:27.908389 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.908375    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:05:27.908425 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.908391    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:05:27.908425 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.908400    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:27.909199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.909188    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:27.911059 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.911048    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:05:27.915365 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915350    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:27.915549 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915539    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:05:27.915584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915573    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:05:27.915616 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915587    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:05:27.915616 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915604    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:05:27.915616 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915614    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:05:27.915715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.915624    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:05:27.916053 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.916041    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:27.916099 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.916060    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:27.918144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.918127    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:05:27.920794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.920779    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:05:27.920852 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.920812    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:05:27.922145 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922132    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:05:27.922187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922152    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:05:27.922187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922159    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:05:27.922187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922165    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:05:27.922187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922175    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:05:27.922187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922181    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922204    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922212    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922220    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922226    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922241    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:05:27.922327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.922247    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:05:27.923079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.923069    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:05:27.923079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.923080    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:05:27.926579 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.926566    2559 server.go:1268] "Started kubelet"
Jul 06 19:05:27.926689 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.926654    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:05:27.926766 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.926710    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:05:27.926817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.926706    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:05:27.927646 ip-10-0-134-25 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:05:27.930489 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.930444    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:05:27.930577 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.930498    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:05:27.930577 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.930510    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:05:27.930772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.930752    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:05:27.930832 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.930807    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8fqk4"
Jul 06 19:05:27.932144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.932126    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:05:27.934376 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.934359    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:05:27.936334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.936317    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8fqk4"
Jul 06 19:05:27.936682 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.935684    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-25.ec2.internal.18bfc8c57905b620  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-25.ec2.internal,UID:ip-10-0-134-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-25.ec2.internal,},FirstTimestamp:2026-07-06 19:05:27.926535712 +0000 UTC m=+0.358793530,LastTimestamp:2026-07-06 19:05:27.926535712 +0000 UTC m=+0.358793530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-25.ec2.internal,}"
Jul 06 19:05:27.940806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.940790    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:05:27.940806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.940797    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:27.940981 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.940963    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:27.941656 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941637    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:05:27.941742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941720    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:05:27.941742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941736    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:05:27.941859 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941745    2559 factory.go:55] Registering systemd factory
Jul 06 19:05:27.941859 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941761    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:05:27.941947 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941871    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:05:27.941947 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.941881    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:05:27.942056 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942034    2559 factory.go:153] Registering CRI-O factory
Jul 06 19:05:27.942056 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942048    2559 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:05:27.942124 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942101    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:05:27.942124 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942123    2559 factory.go:103] Registering Raw factory
Jul 06 19:05:27.942197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942135    2559 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:05:27.942734 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.942720    2559 manager.go:349] Starting recovery of all containers
Jul 06 19:05:27.952186 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.952029    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:27.953683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.953663    2559 manager.go:354] Recovery completed
Jul 06 19:05:27.955737 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:27.955719    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-25.ec2.internal\" not found" node="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:27.958094 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.958081    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.960098 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960083    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.960167 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960115    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.960167 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960132    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.960653 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960640    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:05:27.960653 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960651    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:05:27.960732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960668    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:27.960732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.960653    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.961466 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961451    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.961521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961477    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.961521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961487    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.961966 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961953    2559 policy_none.go:49] "None policy: Start"
Jul 06 19:05:27.962002 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961971    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:05:27.962002 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.961982    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:05:27.963350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:27.963334    2559 policy_none.go:47] "Start"
Jul 06 19:05:28.004705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.004651    2559 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:05:28.004705 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.004696    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:05:28.004705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.004707    2559 server.go:87] "Starting device plugin registration server"
Jul 06 19:05:28.005026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.005011    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:05:28.005091 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.005030    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:05:28.005148 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.005121    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:05:28.005247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.005208    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:05:28.005247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.005220    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:05:28.005800 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.005771    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:05:28.005876 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.005841    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.106193 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.106150    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:28.107721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.107190    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:28.107721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.107224    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:28.107721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.107237    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:28.107721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.107272    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.115949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.115918    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.116025 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.115957    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-25.ec2.internal\": node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.129671 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.129647    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.133772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.133746    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:05:28.135087 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.135062    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:05:28.135172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.135109    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:05:28.135172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.135133    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:05:28.135254 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.135175    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:05:28.138096 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.138079    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:28.233354 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.233307    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.235658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.235631    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"]
Jul 06 19:05:28.235725 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.235712    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:28.237537 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.237520    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:28.237642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.237552    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:28.237642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.237565    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:28.239030 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239017    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:28.239199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.239253 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239238    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:28.239789 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239772    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:28.239853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239805    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:28.239853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239816    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:28.239922 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239774    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:28.239922 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239888    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:28.239922 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.239901    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:28.241344 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.241329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.241397 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.241358    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:28.242025 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.242003    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:28.242117 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.242032    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:28.242117 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.242045    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:28.243322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.243304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.243396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.243337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.243396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.243363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/65902c972529daec087ce8445b0d59a7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"65902c972529daec087ce8445b0d59a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.263983 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.263912    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-25.ec2.internal\" not found" node="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.268748 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.268731    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-25.ec2.internal\" not found" node="ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.333662 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.333631    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.344225 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.344357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.344357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/65902c972529daec087ce8445b0d59a7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"65902c972529daec087ce8445b0d59a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.344357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344292    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/65902c972529daec087ce8445b0d59a7-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"65902c972529daec087ce8445b0d59a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.344357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344295    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.344357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.344320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0952fa23216b5d993529409bfd281158-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"0952fa23216b5d993529409bfd281158\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.434307 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.434268    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.540956 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.540855    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.569386 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.569358    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.574356 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.574264    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:28.642277 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.642228    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.748524 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.748482    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.849593 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.849505    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:28.875795 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.875763    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:05:28.875973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.875938    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:28.876033 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.875976    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:28.943114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.943046    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:28 +0000 UTC" deadline="2028-04-19 18:50:16.020947432 +0000 UTC"
Jul 06 19:05:28.943114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:28.943108    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15671h44m47.077844761s"
Jul 06 19:05:28.949653 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:28.949629    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:29.050084 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:29.050046    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:29.150520 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:29.150455    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found"
Jul 06 19:05:29.180554 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:29.180521    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65902c972529daec087ce8445b0d59a7.slice/crio-9584c18786adc25b2c7a4ed98a74152823d3c8f4ede0c80ece2d869e09a586c7 WatchSource:0}: Error finding container 9584c18786adc25b2c7a4ed98a74152823d3c8f4ede0c80ece2d869e09a586c7: Status 404 returned error can't find the container with id 9584c18786adc25b2c7a4ed98a74152823d3c8f4ede0c80ece2d869e09a586c7
Jul 06 19:05:29.189402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.189386    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:05:29.196429 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:29.196409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0952fa23216b5d993529409bfd281158.slice/crio-ef6b0f6de82963000402fccda8c1a616ed552e39a99bcc7df648e08f3d650aa5 WatchSource:0}: Error finding container ef6b0f6de82963000402fccda8c1a616ed552e39a99bcc7df648e08f3d650aa5: Status 404 returned error can't find the container with id ef6b0f6de82963000402fccda8c1a616ed552e39a99bcc7df648e08f3d650aa5
Jul 06 19:05:29.210021 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.209986    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:29.241575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.241545    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:29.252089 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.252068    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:29.253963 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.253948    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal"
Jul 06 19:05:29.263691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.263671    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:29.282851 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.282831    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:29.720851 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.720821    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:29.917363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.917335    2559 apiserver.go:52] "Watching apiserver"
Jul 06 19:05:29.927242 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.927136    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:05:29.927837 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.927775    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-wfhdm","kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c","openshift-dns/node-resolver-htwtx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal","openshift-multus/multus-additional-cni-plugins-zhfg6","openshift-multus/multus-zxvvp","openshift-multus/network-metrics-daemon-526gg","openshift-network-diagnostics/network-check-target-rbkr6","kube-system/global-pull-secret-syncer-rzt79","kube-system/konnectivity-agent-bcrgx","openshift-cluster-node-tuning-operator/tuned-5kmjc","openshift-image-registry/node-ca-hdcth","openshift-network-operator/iptables-alerter-xf2mz"]
Jul 06 19:05:29.929984 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.929928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.931545 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.931517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:29.932974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.932941    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:05:29.933102 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.933077    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.933582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.933211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-79fmx\""
Jul 06 19:05:29.933582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.933249    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:05:29.933582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.933314    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.933582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.933365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.934697 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.934332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:05:29.934697 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.934447    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:05:29.934697 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.934556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5qmrt\""
Jul 06 19:05:29.934899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.934720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:29.936500 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.936298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:29.936772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.936750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:05:29.937230 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937209    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.937317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w7z95\""
Jul 06 19:05:29.937903 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937531    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.937903 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937583    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rg6tk\""
Jul 06 19:05:29.937903 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.937903 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.937812    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.938172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.938056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.939309 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.939104    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.939928 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.939493    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qb556\""
Jul 06 19:05:29.939928 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.939754    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.939928 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.939825    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:05:29.940145 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.940083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:29.940202 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:29.940163    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:29.940735 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.940698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vsqh8\""
Jul 06 19:05:29.941003 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.940984    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:05:29.941259 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.941243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:29.941339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.941304    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:05:29.942297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.942274    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:29.942768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.942752    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:29.942855 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:29.942825    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:29.944019 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.943986    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.944381 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.944360    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:05:29.944712 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.944693    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9htb5\""
Jul 06 19:05:29.944906 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.944890    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.945791 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.945773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:29.945887 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:29.945831    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:29.946775 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.946172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:29.947905 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.947881    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:29.948778 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.948757    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:05:29.949555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.949395    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.949747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.949729    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:05:29.951583 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.951457    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:05:29.951583 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.951520    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.951800 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.951733    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xlqm9\""
Jul 06 19:05:29.951800 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.951749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:29.951944 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.951776    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kn4bb\""
Jul 06 19:05:29.952226 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.952174    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:29.953879 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.953858    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:05:29.956834 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-hostroot\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.956935 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-etc-kubernetes\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.956935 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31ed6f1-ba57-4a5d-b836-8001188f47aa-hosts-file\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:29.956935 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:29.957122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9bzt\" (UniqueName: \"kubernetes.io/projected/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kube-api-access-p9bzt\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.957122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.956997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d345c0b-744a-49e5-82be-8b65be30c8e5-iptables-alerter-script\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:29.957122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.957122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/894f72ac-3300-45c3-ae67-92fba9f94098-host\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:29.957122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktpq\" (UniqueName: \"kubernetes.io/projected/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-kube-api-access-dktpq\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-socket-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d345c0b-744a-49e5-82be-8b65be30c8e5-host-slash\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-cnibin\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957274    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/894f72ac-3300-45c3-ae67-92fba9f94098-serviceca\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-netns\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-conf-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.957376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ef25f62-ab39-45e9-8c93-17c4f449f76a-agent-certs\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:29.957767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-sys-fs\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.957767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsq6\" (UniqueName: \"kubernetes.io/projected/0d345c0b-744a-49e5-82be-8b65be30c8e5-kube-api-access-jhsq6\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:29.957767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-os-release\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.957767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.957557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-bin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-multus\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31ed6f1-ba57-4a5d-b836-8001188f47aa-tmp-dir\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:29.958246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.958445 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.958445 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.958445 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62f2j\" (UniqueName: \"kubernetes.io/projected/894f72ac-3300-45c3-ae67-92fba9f94098-kube-api-access-62f2j\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:29.958604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cni-binary-copy\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-socket-dir-parent\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958524    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-daemon-config\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-multus-certs\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-os-release\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.958827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:29.958827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cnibin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.958827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntzmf\" (UniqueName: \"kubernetes.io/projected/b67ceea1-bbb9-494e-9ca8-130eed7124c6-kube-api-access-ntzmf\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-device-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.958999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-kubelet\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ef25f62-ab39-45e9-8c93-17c4f449f76a-konnectivity-ca\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-registration-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959091    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-system-cni-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.959173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959146    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c22q\" (UniqueName: \"kubernetes.io/projected/47563566-8580-4281-ade1-2b0bbc5c7a2e-kube-api-access-5c22q\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:29.959629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-system-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.959629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-k8s-cni-cncf-io\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:29.959629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.959450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpj4c\" (UniqueName: \"kubernetes.io/projected/a31ed6f1-ba57-4a5d-b836-8001188f47aa-kube-api-access-qpj4c\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:29.980092 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.980044    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q4hgz"
Jul 06 19:05:29.987886 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:29.987825    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q4hgz"
Jul 06 19:05:30.042563 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.042533    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:05:30.060000 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.059969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:30.060155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cnibin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-config\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-kubelet\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-modprobe-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-kubelet\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-netns\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ef25f62-ab39-45e9-8c93-17c4f449f76a-konnectivity-ca\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060273    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-kubelet\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-system-cni-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c22q\" (UniqueName: \"kubernetes.io/projected/47563566-8580-4281-ade1-2b0bbc5c7a2e-kube-api-access-5c22q\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpj4c\" (UniqueName: \"kubernetes.io/projected/a31ed6f1-ba57-4a5d-b836-8001188f47aa-kube-api-access-qpj4c\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-etc-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-ovn\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-etc-kubernetes\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31ed6f1-ba57-4a5d-b836-8001188f47aa-hosts-file\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-tuned\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-var-lib-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/894f72ac-3300-45c3-ae67-92fba9f94098-host\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktpq\" (UniqueName: \"kubernetes.io/projected/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-kube-api-access-dktpq\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-system-cni-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060217    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-bin\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-env-overrides\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-script-lib\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-socket-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-cnibin\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.060931 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/894f72ac-3300-45c3-ae67-92fba9f94098-serviceca\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-netns\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060906    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31ed6f1-ba57-4a5d-b836-8001188f47aa-hosts-file\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-conf-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060927    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ef25f62-ab39-45e9-8c93-17c4f449f76a-konnectivity-ca\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060951    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-conf-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-kubernetes\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.060160    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cnibin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-cnibin\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-sys\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061136    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/894f72ac-3300-45c3-ae67-92fba9f94098-host\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysconfig\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061187    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-etc-kubernetes\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsq6\" (UniqueName: \"kubernetes.io/projected/0d345c0b-744a-49e5-82be-8b65be30c8e5-kube-api-access-jhsq6\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-bin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061235    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-socket-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061368    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-netns\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061407    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-bin\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.061782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061436    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d7cx\" (UniqueName: \"kubernetes.io/projected/e855130e-1155-4a6e-97a4-dee6a80c2a37-kube-api-access-6d7cx\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-run\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061471    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62f2j\" (UniqueName: \"kubernetes.io/projected/894f72ac-3300-45c3-ae67-92fba9f94098-kube-api-access-62f2j\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061545    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cni-binary-copy\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-socket-dir-parent\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061663    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-socket-dir-parent\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-multus-certs\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-systemd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-os-release\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061782    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-multus-certs\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061854    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/894f72ac-3300-45c3-ae67-92fba9f94098-serviceca\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.062673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061881    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47563566-8580-4281-ade1-2b0bbc5c7a2e-os-release\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-device-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061929    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-device-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.061965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-var-lib-kubelet\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-systemd-units\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-cni-binary-copy\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-registration-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-system-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062205    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-registration-dir\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-k8s-cni-cncf-io\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062250    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-system-cni-dir\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-host\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062276    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-run-k8s-cni-cncf-io\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-hostroot\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.063584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-log-socket\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-netd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-hostroot\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062428    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9bzt\" (UniqueName: \"kubernetes.io/projected/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kube-api-access-p9bzt\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d345c0b-744a-49e5-82be-8b65be30c8e5-iptables-alerter-script\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.062522    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-node-log\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.062661    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.562616217 +0000 UTC m=+2.994874037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d345c0b-744a-49e5-82be-8b65be30c8e5-host-slash\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062743    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d345c0b-744a-49e5-82be-8b65be30c8e5-host-slash\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-systemd\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-slash\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovn-node-metrics-cert\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ef25f62-ab39-45e9-8c93-17c4f449f76a-agent-certs\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.062955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-sys-fs\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.064379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-os-release\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063084    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-os-release\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-multus\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31ed6f1-ba57-4a5d-b836-8001188f47aa-tmp-dir\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063141    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d345c0b-744a-49e5-82be-8b65be30c8e5-iptables-alerter-script\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-lib-modules\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-tmp\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b67ceea1-bbb9-494e-9ca8-130eed7124c6-host-var-lib-cni-multus\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-daemon-config\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063352    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063377    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-etc-selinux\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzmf\" (UniqueName: \"kubernetes.io/projected/b67ceea1-bbb9-494e-9ca8-130eed7124c6-kube-api-access-ntzmf\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-conf\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063435    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a1657d-3a4f-4db9-a5da-926a1bb20edd-sys-fs\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stvb\" (UniqueName: \"kubernetes.io/projected/12cab4aa-30c8-4701-96dc-bf6fe11103bb-kube-api-access-4stvb\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.065281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063501    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-kubelet-config\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.066122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.063519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-dbus\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.066122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.064053    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47563566-8580-4281-ade1-2b0bbc5c7a2e-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.066122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.064084    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31ed6f1-ba57-4a5d-b836-8001188f47aa-tmp-dir\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.066122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.064235    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b67ceea1-bbb9-494e-9ca8-130eed7124c6-multus-daemon-config\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.067107 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.067034    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:30.067107 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.067061    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:30.067107 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.067076    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.067363 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.067160    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.567139984 +0000 UTC m=+2.999397803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.068342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.068317    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ef25f62-ab39-45e9-8c93-17c4f449f76a-agent-certs\") pod \"konnectivity-agent-bcrgx\" (UID: \"4ef25f62-ab39-45e9-8c93-17c4f449f76a\") " pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:30.070161 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.070137    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c22q\" (UniqueName: \"kubernetes.io/projected/47563566-8580-4281-ade1-2b0bbc5c7a2e-kube-api-access-5c22q\") pod \"multus-additional-cni-plugins-zhfg6\" (UID: \"47563566-8580-4281-ade1-2b0bbc5c7a2e\") " pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.076527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.074669    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsq6\" (UniqueName: \"kubernetes.io/projected/0d345c0b-744a-49e5-82be-8b65be30c8e5-kube-api-access-jhsq6\") pod \"iptables-alerter-xf2mz\" (UID: \"0d345c0b-744a-49e5-82be-8b65be30c8e5\") " pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.076527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.076324    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpj4c\" (UniqueName: \"kubernetes.io/projected/a31ed6f1-ba57-4a5d-b836-8001188f47aa-kube-api-access-qpj4c\") pod \"node-resolver-htwtx\" (UID: \"a31ed6f1-ba57-4a5d-b836-8001188f47aa\") " pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.076862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.076836    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62f2j\" (UniqueName: \"kubernetes.io/projected/894f72ac-3300-45c3-ae67-92fba9f94098-kube-api-access-62f2j\") pod \"node-ca-hdcth\" (UID: \"894f72ac-3300-45c3-ae67-92fba9f94098\") " pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.077262 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.077244    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9bzt\" (UniqueName: \"kubernetes.io/projected/95a1657d-3a4f-4db9-a5da-926a1bb20edd-kube-api-access-p9bzt\") pod \"aws-ebs-csi-driver-node-n8q2c\" (UID: \"95a1657d-3a4f-4db9-a5da-926a1bb20edd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.077471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.077449    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktpq\" (UniqueName: \"kubernetes.io/projected/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-kube-api-access-dktpq\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:30.078752 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.078717    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntzmf\" (UniqueName: \"kubernetes.io/projected/b67ceea1-bbb9-494e-9ca8-130eed7124c6-kube-api-access-ntzmf\") pod \"multus-zxvvp\" (UID: \"b67ceea1-bbb9-494e-9ca8-130eed7124c6\") " pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.122823 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.122774    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:30.141889 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.141834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"0952fa23216b5d993529409bfd281158","Type":"ContainerStarted","Data":"ef6b0f6de82963000402fccda8c1a616ed552e39a99bcc7df648e08f3d650aa5"}
Jul 06 19:05:30.143199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.143159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" event={"ID":"65902c972529daec087ce8445b0d59a7","Type":"ContainerStarted","Data":"9584c18786adc25b2c7a4ed98a74152823d3c8f4ede0c80ece2d869e09a586c7"}
Jul 06 19:05:30.164198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-config\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-modprobe-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-kubelet\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-netns\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-etc-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164299    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-etc-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-netns\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164337    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-kubelet\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164481    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-modprobe-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-ovn\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164530    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-ovn\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-tuned\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-var-lib-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-var-lib-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-bin\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164682    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-env-overrides\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-script-lib\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-bin\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-kubernetes\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-sys\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysconfig\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d7cx\" (UniqueName: \"kubernetes.io/projected/e855130e-1155-4a6e-97a4-dee6a80c2a37-kube-api-access-6d7cx\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-run\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164867    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-kubernetes\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.164898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-systemd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164930    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysconfig\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.164966    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-config\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165002    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-sys\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-var-lib-kubelet\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-systemd-units\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165057    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-systemd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165063    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-var-lib-kubelet\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-host\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165174    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-run\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165183    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-env-overrides\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-log-socket\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.165547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165214    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-log-socket\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165220    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-run-openvswitch\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-netd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165268    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-host\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-node-log\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.165305    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-cni-netd\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165349    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-node-log\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165305    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-systemd-units\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165359    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovnkube-script-lib\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.165378    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.665358879 +0000 UTC m=+3.097616687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-systemd\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165396    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-systemd\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-slash\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165426    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-d\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovn-node-metrics-cert\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-lib-modules\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.166247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165478    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e855130e-1155-4a6e-97a4-dee6a80c2a37-host-slash\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-tmp\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-conf\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4stvb\" (UniqueName: \"kubernetes.io/projected/12cab4aa-30c8-4701-96dc-bf6fe11103bb-kube-api-access-4stvb\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-kubelet-config\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-dbus\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165616    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-lib-modules\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-sysctl-conf\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165734    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-dbus\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.167046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.165753    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-kubelet-config\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.167534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.167511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-etc-tuned\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.168349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.168320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e855130e-1155-4a6e-97a4-dee6a80c2a37-ovn-node-metrics-cert\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.168349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.168338    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12cab4aa-30c8-4701-96dc-bf6fe11103bb-tmp\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.176552 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.176529    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d7cx\" (UniqueName: \"kubernetes.io/projected/e855130e-1155-4a6e-97a4-dee6a80c2a37-kube-api-access-6d7cx\") pod \"ovnkube-node-wfhdm\" (UID: \"e855130e-1155-4a6e-97a4-dee6a80c2a37\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.176552 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.176538    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stvb\" (UniqueName: \"kubernetes.io/projected/12cab4aa-30c8-4701-96dc-bf6fe11103bb-kube-api-access-4stvb\") pod \"tuned-5kmjc\" (UID: \"12cab4aa-30c8-4701-96dc-bf6fe11103bb\") " pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.244711 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.244618    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zxvvp"
Jul 06 19:05:30.254904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.254879    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:30.266105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.266078    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c"
Jul 06 19:05:30.272130 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.272111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-htwtx"
Jul 06 19:05:30.281024 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.281002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xf2mz"
Jul 06 19:05:30.288891 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.288871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhfg6"
Jul 06 19:05:30.298100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.298077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdcth"
Jul 06 19:05:30.305250 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.305231    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:30.311099 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.311082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5kmjc"
Jul 06 19:05:30.569290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.569195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:30.569290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.569259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569372    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569383    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569400    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569414    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569452    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:31.569433083 +0000 UTC m=+4.001690912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.569482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.569469    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:31.569462043 +0000 UTC m=+4.001719846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.669595 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.669554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:30.669789 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.669741    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.669837 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:30.669818    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:31.669799783 +0000 UTC m=+4.102057591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.991353 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.991284    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:30 +0000 UTC" deadline="2028-04-21 15:53:48.184514436 +0000 UTC"
Jul 06 19:05:30.991887 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:30.991378    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15716h48m17.193143263s"
Jul 06 19:05:31.136429 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.136392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:31.136615 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.136521    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:31.244819 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.244786    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894f72ac_3300_45c3_ae67_92fba9f94098.slice/crio-b730a036e378cc1cd2dc68d29575874af3f0f371d27a650c514b0eef10cb93c2 WatchSource:0}: Error finding container b730a036e378cc1cd2dc68d29575874af3f0f371d27a650c514b0eef10cb93c2: Status 404 returned error can't find the container with id b730a036e378cc1cd2dc68d29575874af3f0f371d27a650c514b0eef10cb93c2
Jul 06 19:05:31.247514 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.247485    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47563566_8580_4281_ade1_2b0bbc5c7a2e.slice/crio-ea3339d615b37ecd914b5551b1d858165e2cc83ef7233bc18827856d1ca2f71c WatchSource:0}: Error finding container ea3339d615b37ecd914b5551b1d858165e2cc83ef7233bc18827856d1ca2f71c: Status 404 returned error can't find the container with id ea3339d615b37ecd914b5551b1d858165e2cc83ef7233bc18827856d1ca2f71c
Jul 06 19:05:31.250904 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.250873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67ceea1_bbb9_494e_9ca8_130eed7124c6.slice/crio-0ea4db03aa25368165601c720666a874f1e6aa75c37b4d4774620753dd628b1c WatchSource:0}: Error finding container 0ea4db03aa25368165601c720666a874f1e6aa75c37b4d4774620753dd628b1c: Status 404 returned error can't find the container with id 0ea4db03aa25368165601c720666a874f1e6aa75c37b4d4774620753dd628b1c
Jul 06 19:05:31.252727 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.252612    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31ed6f1_ba57_4a5d_b836_8001188f47aa.slice/crio-5a2184ba49ac08f3d0ea5a422e4490c05375c75bc13b41af7f9c7e8240a145df WatchSource:0}: Error finding container 5a2184ba49ac08f3d0ea5a422e4490c05375c75bc13b41af7f9c7e8240a145df: Status 404 returned error can't find the container with id 5a2184ba49ac08f3d0ea5a422e4490c05375c75bc13b41af7f9c7e8240a145df
Jul 06 19:05:31.253075 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.253051    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef25f62_ab39_45e9_8c93_17c4f449f76a.slice/crio-a84af0e74819c8d17eb1807cd0100d49353a9d4649ad0662116a7102a140dc7d WatchSource:0}: Error finding container a84af0e74819c8d17eb1807cd0100d49353a9d4649ad0662116a7102a140dc7d: Status 404 returned error can't find the container with id a84af0e74819c8d17eb1807cd0100d49353a9d4649ad0662116a7102a140dc7d
Jul 06 19:05:31.253943 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.253791    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cab4aa_30c8_4701_96dc_bf6fe11103bb.slice/crio-7bb000076775a1e481e69c059fab93e76a349ceb3bb9e595239524a3f6df94c1 WatchSource:0}: Error finding container 7bb000076775a1e481e69c059fab93e76a349ceb3bb9e595239524a3f6df94c1: Status 404 returned error can't find the container with id 7bb000076775a1e481e69c059fab93e76a349ceb3bb9e595239524a3f6df94c1
Jul 06 19:05:31.255380 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.255111    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode855130e_1155_4a6e_97a4_dee6a80c2a37.slice/crio-772a95253bd56c2e2a5a751d40447d2904e94f14e27921cd7f56b3d4ca78a979 WatchSource:0}: Error finding container 772a95253bd56c2e2a5a751d40447d2904e94f14e27921cd7f56b3d4ca78a979: Status 404 returned error can't find the container with id 772a95253bd56c2e2a5a751d40447d2904e94f14e27921cd7f56b3d4ca78a979
Jul 06 19:05:31.255778 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.255682    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a1657d_3a4f_4db9_a5da_926a1bb20edd.slice/crio-d6b4bbcf7dbbf3039a310642978c63899f4fb2f6f14cfc5e3d26f02d1e9dc56b WatchSource:0}: Error finding container d6b4bbcf7dbbf3039a310642978c63899f4fb2f6f14cfc5e3d26f02d1e9dc56b: Status 404 returned error can't find the container with id d6b4bbcf7dbbf3039a310642978c63899f4fb2f6f14cfc5e3d26f02d1e9dc56b
Jul 06 19:05:31.258028 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:05:31.257770    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d345c0b_744a_49e5_82be_8b65be30c8e5.slice/crio-9890544cfe940086f2dbb7c7c799240ad964b953686d3ffb6e502fdda5ba5b0b WatchSource:0}: Error finding container 9890544cfe940086f2dbb7c7c799240ad964b953686d3ffb6e502fdda5ba5b0b: Status 404 returned error can't find the container with id 9890544cfe940086f2dbb7c7c799240ad964b953686d3ffb6e502fdda5ba5b0b
Jul 06 19:05:31.577093 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.576881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:31.577226 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.577130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:31.577226 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577052    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:31.577335 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577236    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:33.577212584 +0000 UTC m=+6.009470404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:31.577335 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577269    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:31.577335 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577283    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:31.577335 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577296    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:31.577540 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.577338    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:33.577325807 +0000 UTC m=+6.009583611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:31.678522 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.678208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:31.678522 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.678429    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:31.678522 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:31.678502    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:33.67848089 +0000 UTC m=+6.110738714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:31.992520 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.992436    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:30 +0000 UTC" deadline="2027-12-26 00:38:49.162778867 +0000 UTC"
Jul 06 19:05:31.992520 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:31.992517    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12893h33m17.17026728s"
Jul 06 19:05:32.136232 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.136139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:32.136423 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:32.136279    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:32.136711 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.136515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:32.136711 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:32.136663    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:32.162992 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.162888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xf2mz" event={"ID":"0d345c0b-744a-49e5-82be-8b65be30c8e5","Type":"ContainerStarted","Data":"9890544cfe940086f2dbb7c7c799240ad964b953686d3ffb6e502fdda5ba5b0b"}
Jul 06 19:05:32.176027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.175756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5kmjc" event={"ID":"12cab4aa-30c8-4701-96dc-bf6fe11103bb","Type":"ContainerStarted","Data":"7bb000076775a1e481e69c059fab93e76a349ceb3bb9e595239524a3f6df94c1"}
Jul 06 19:05:32.183434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.183347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcrgx" event={"ID":"4ef25f62-ab39-45e9-8c93-17c4f449f76a","Type":"ContainerStarted","Data":"a84af0e74819c8d17eb1807cd0100d49353a9d4649ad0662116a7102a140dc7d"}
Jul 06 19:05:32.196347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.195978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-htwtx" event={"ID":"a31ed6f1-ba57-4a5d-b836-8001188f47aa","Type":"ContainerStarted","Data":"5a2184ba49ac08f3d0ea5a422e4490c05375c75bc13b41af7f9c7e8240a145df"}
Jul 06 19:05:32.208811 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.208778    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zxvvp" event={"ID":"b67ceea1-bbb9-494e-9ca8-130eed7124c6","Type":"ContainerStarted","Data":"0ea4db03aa25368165601c720666a874f1e6aa75c37b4d4774620753dd628b1c"}
Jul 06 19:05:32.219491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.219457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerStarted","Data":"ea3339d615b37ecd914b5551b1d858165e2cc83ef7233bc18827856d1ca2f71c"}
Jul 06 19:05:32.224459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.224426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdcth" event={"ID":"894f72ac-3300-45c3-ae67-92fba9f94098","Type":"ContainerStarted","Data":"b730a036e378cc1cd2dc68d29575874af3f0f371d27a650c514b0eef10cb93c2"}
Jul 06 19:05:32.229975 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.229944    2559 generic.go:356] "Generic (PLEG): container finished" podID="0952fa23216b5d993529409bfd281158" containerID="6d7fd0babe4561e46f77c059f7559453211b1dd357228ccac30e2ad38399a03c" exitCode=0
Jul 06 19:05:32.230114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.230052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"0952fa23216b5d993529409bfd281158","Type":"ContainerDied","Data":"6d7fd0babe4561e46f77c059f7559453211b1dd357228ccac30e2ad38399a03c"}
Jul 06 19:05:32.249307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.248667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" event={"ID":"65902c972529daec087ce8445b0d59a7","Type":"ContainerStarted","Data":"543da9ec2e2f2e35d4f0286d7224283cbcc63ee6553b251b7ecd197e21b394fe"}
Jul 06 19:05:32.264477 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.264355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c" event={"ID":"95a1657d-3a4f-4db9-a5da-926a1bb20edd","Type":"ContainerStarted","Data":"d6b4bbcf7dbbf3039a310642978c63899f4fb2f6f14cfc5e3d26f02d1e9dc56b"}
Jul 06 19:05:32.265799 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.265743    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" podStartSLOduration=3.2657222040000002 podStartE2EDuration="3.265722204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:32.264565177 +0000 UTC m=+4.696823006" watchObservedRunningTime="2026-07-06 19:05:32.265722204 +0000 UTC m=+4.697980032"
Jul 06 19:05:32.276118 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:32.276086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"772a95253bd56c2e2a5a751d40447d2904e94f14e27921cd7f56b3d4ca78a979"}
Jul 06 19:05:33.136529 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:33.136356    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:33.136529 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.136499    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:33.303393 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:33.303325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"0952fa23216b5d993529409bfd281158","Type":"ContainerStarted","Data":"f434ec613e89f26e794d7a897e3f7e1066f029b25f65c480e9ba99c33b89740b"}
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:33.595684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:33.595747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.595905    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.595923    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.595936    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.596020    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:37.595998355 +0000 UTC m=+10.028256176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.596421    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:33.596564 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.596468    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:37.59645443 +0000 UTC m=+10.028712253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:33.697432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:33.696780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:33.697432 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.697000    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:33.697432 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:33.697067    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:37.697048835 +0000 UTC m=+10.129306658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:34.137142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:34.137109    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:34.137622 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:34.137252    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:34.139075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:34.139040    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:34.139207 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:34.139181    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:35.135648 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:35.135608    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:35.135814 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:35.135744    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:36.137702 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:36.137057    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:36.137702 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:36.137202    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:36.137702 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:36.137538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:36.137702 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:36.137655    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:37.135639 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:37.135604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:37.135806 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.135732    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:37.632854 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:37.632812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:37.632912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633044    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633067    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633095    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633111    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633112    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.633091765 +0000 UTC m=+18.065349569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:37.633313 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.633174    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.633158242 +0000 UTC m=+18.065416050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:37.734241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:37.734166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:37.734464 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.734339    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:37.734464 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:37.734420    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:45.734398556 +0000 UTC m=+18.166656377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:38.136624 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:38.136569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:38.136803 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:38.136681    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:38.137067 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:38.136899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:38.137067 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:38.137032    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:39.135607 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:39.135575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:39.136138 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:39.135689    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:40.136380 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:40.136343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:40.136811 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:40.136483    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:40.136811 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:40.136542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:40.136811 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:40.136673    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:41.135337 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:41.135302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:41.135554 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:41.135448    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:42.135539 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:42.135501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:42.135980 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:42.135563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:42.135980 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:42.135649    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:42.135980 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:42.135700    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:43.135428 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:43.135394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:43.135589 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:43.135514    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:44.135491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:44.135418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:44.135491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:44.135447    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:44.136020 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:44.135562    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:44.136020 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:44.135690    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:45.135343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:45.135309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:45.135519 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.135438    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:45.696268 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:45.696221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:45.696308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696386    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696399    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696406    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696420    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696462    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.696444212 +0000 UTC m=+34.128702033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:45.696708 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.696477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.696470233 +0000 UTC m=+34.128728035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:45.796821 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:45.796780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:45.797008 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.796953    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:45.797138 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:45.797033    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:01.797014522 +0000 UTC m=+34.229272342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:46.136028 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:46.135994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:46.136199 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:46.136134    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:46.136199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:46.136183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:46.136318 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:46.136298    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:47.136111 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:47.136077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:47.136507 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:47.136187    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:48.136757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:48.136720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:48.137219 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:48.136829    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:48.137219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:48.136881    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:48.137219 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:48.137021    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:49.136363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:49.136330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:49.136567 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:49.136451    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:50.136248 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.136092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:50.136848 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.136171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:50.136959 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:50.136918    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:50.137026 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:50.136964    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:50.339798 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.339768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c" event={"ID":"95a1657d-3a4f-4db9-a5da-926a1bb20edd","Type":"ContainerStarted","Data":"43887abb03ad25a77d6c6f854e1e992d9d25d330e471826835fa4fd19f646e1f"}
Jul 06 19:05:50.341190 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.341171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:05:50.341523 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.341503    2559 generic.go:356] "Generic (PLEG): container finished" podID="e855130e-1155-4a6e-97a4-dee6a80c2a37" containerID="5a4a0bd9b7c8b8fb665de4766e635a9d4f6304ba9272f9871cf4d4f531aa27dc" exitCode=1
Jul 06 19:05:50.341600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.341583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerDied","Data":"5a4a0bd9b7c8b8fb665de4766e635a9d4f6304ba9272f9871cf4d4f531aa27dc"}
Jul 06 19:05:50.341656 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.341645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"ed424b50330bc8cb87de6a1244aea6c60bd12657ac50a49c2cd899557528c077"}
Jul 06 19:05:50.342748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.342728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5kmjc" event={"ID":"12cab4aa-30c8-4701-96dc-bf6fe11103bb","Type":"ContainerStarted","Data":"381dd05f1270148781bb23b6756ddce5dc7553963e43ee7784aa20d2c1cfa865"}
Jul 06 19:05:50.343979 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.343959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcrgx" event={"ID":"4ef25f62-ab39-45e9-8c93-17c4f449f76a","Type":"ContainerStarted","Data":"d4c47a2a5a6518c1a5e3ab72f2f6fed9f5a73736502c1ac06cb7fb82b7f255c0"}
Jul 06 19:05:50.345418 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.345395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-htwtx" event={"ID":"a31ed6f1-ba57-4a5d-b836-8001188f47aa","Type":"ContainerStarted","Data":"8dab1cf02afb279692c3862df7dae744f0bb436c38967a00194c2b270d75a0c2"}
Jul 06 19:05:50.346912 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.346890    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zxvvp" event={"ID":"b67ceea1-bbb9-494e-9ca8-130eed7124c6","Type":"ContainerStarted","Data":"ab27e726f556392d423474549c1eb4ccb62d013773321191d40021d5aa8a656b"}
Jul 06 19:05:50.348778 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.348758    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="63a59a36ea85b220cab2ce71ca2a8022389f62289f39c1013702b01e9ccde276" exitCode=0
Jul 06 19:05:50.348885 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.348834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"63a59a36ea85b220cab2ce71ca2a8022389f62289f39c1013702b01e9ccde276"}
Jul 06 19:05:50.350424 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.350353    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdcth" event={"ID":"894f72ac-3300-45c3-ae67-92fba9f94098","Type":"ContainerStarted","Data":"747cd4e941dcd97d3c2dea8dc76f33dc0ff1cd5dbd2ded5c234d89f861e3c3fd"}
Jul 06 19:05:50.359768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.359710    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5kmjc" podStartSLOduration=3.762537741 podStartE2EDuration="22.359696117s" totalImagesPullingTime="18.597158376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.359610469 +0000 UTC m=+22.791868294" watchObservedRunningTime="2026-07-06 19:05:50.359696117 +0000 UTC m=+22.791953942"
Jul 06 19:05:50.360261 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.360232    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" podStartSLOduration=21.36022176 podStartE2EDuration="21.36022176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:33.320405596 +0000 UTC m=+5.752663439" watchObservedRunningTime="2026-07-06 19:05:50.36022176 +0000 UTC m=+22.792479584"
Jul 06 19:05:50.398851 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.398704    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zxvvp" podStartSLOduration=3.786685052 podStartE2EDuration="22.398689242s" totalImagesPullingTime="18.61200419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.398659593 +0000 UTC m=+22.830917416" watchObservedRunningTime="2026-07-06 19:05:50.398689242 +0000 UTC m=+22.830947065"
Jul 06 19:05:50.412773 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.412732    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-htwtx" podStartSLOduration=3.842663178 podStartE2EDuration="22.412718649s" totalImagesPullingTime="18.570055471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.412699455 +0000 UTC m=+22.844957279" watchObservedRunningTime="2026-07-06 19:05:50.412718649 +0000 UTC m=+22.844976472"
Jul 06 19:05:50.427471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.427432    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hdcth" podStartSLOduration=3.828914207 podStartE2EDuration="22.427416749s" totalImagesPullingTime="18.598502542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.426736694 +0000 UTC m=+22.858994518" watchObservedRunningTime="2026-07-06 19:05:50.427416749 +0000 UTC m=+22.859674573"
Jul 06 19:05:50.445091 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.445051    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bcrgx" podStartSLOduration=12.086687739 podStartE2EDuration="22.445036705s" totalImagesPullingTime="10.358348966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.444537544 +0000 UTC m=+22.876795368" watchObservedRunningTime="2026-07-06 19:05:50.445036705 +0000 UTC m=+22.877294528"
Jul 06 19:05:50.509669 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.509637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:50.589818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.589784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:50.645980 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:50.644732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:51.135516 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.135450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:51.135763 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:51.135544    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:51.357238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.357211    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:05:51.358263 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.358232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"37ec5266e0498afe2993d9bfa41724ff0fe17db327869d765378f089f0ec8c87"}
Jul 06 19:05:51.358402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.358319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"033f84f18994fa107f026806b0ea0550742e29334a374c2087ec1a40ad489296"}
Jul 06 19:05:51.358402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.358370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"945b1afc639e49434e3cedcc48e9c6ab4fed1b0f299fefc1da8081dca40f375a"}
Jul 06 19:05:51.358508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.358416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"bd3a58096f00276e2b683982e327d473afd58d6df84e249ff0a57a8967e00a2f"}
Jul 06 19:05:51.359921 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.359891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xf2mz" event={"ID":"0d345c0b-744a-49e5-82be-8b65be30c8e5","Type":"ContainerStarted","Data":"275eb9334188d7c332f531a5ec230dca3211f10ee3c6197671a5ab5c1af39d56"}
Jul 06 19:05:51.375644 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.375600    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xf2mz" podStartSLOduration=4.790353073 podStartE2EDuration="23.375585626s" totalImagesPullingTime="18.585232553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:51.375041007 +0000 UTC m=+23.807298841" watchObservedRunningTime="2026-07-06 19:05:51.375585626 +0000 UTC m=+23.807843450"
Jul 06 19:05:51.401538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.401514    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:05:51.469819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.469782    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:51.470561 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.470537    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:51.568265 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.568233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:51.662388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.662303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:51.724416 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.724349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:51.775285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:51.775243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:52.020510 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.020342    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:51.401532582Z","UUID":"5f808c9d-6079-499c-86f6-e92cb67fb742","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:05:52.021902 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.021881    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:05:52.022047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.021919    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:05:52.136044 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.136017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:52.136209 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:52.136133    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:52.136209 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.136186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:52.136337 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:52.136267    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:52.365021 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.364990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c" event={"ID":"95a1657d-3a4f-4db9-a5da-926a1bb20edd","Type":"ContainerStarted","Data":"8e1cd0861ef2a6f53789b7e82ac024ca09127791eff9d4ddfe6241cab7f1c5f8"}
Jul 06 19:05:52.696892 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:52.696704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:53.135354 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.135324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:53.135536 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:53.135447    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:53.372370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.372333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c" event={"ID":"95a1657d-3a4f-4db9-a5da-926a1bb20edd","Type":"ContainerStarted","Data":"4da58fe5c4a6c536daab1612dd4705ef652ab9b78a9a350017108379d37801c7"}
Jul 06 19:05:53.375821 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.375799    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:05:53.376231 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.376205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"10dc358feb61baf0cca613330bba304e4f61368c673ce784a035f0e61757397e"}
Jul 06 19:05:53.376367 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.376278    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:05:53.393273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.393189    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n8q2c" podStartSLOduration=4.745117653 podStartE2EDuration="25.393175003s" totalImagesPullingTime="20.64805735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:53.391316854 +0000 UTC m=+25.823574707" watchObservedRunningTime="2026-07-06 19:05:53.393175003 +0000 UTC m=+25.825432873"
Jul 06 19:05:53.984004 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.983973    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:53.984612 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:53.984590    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bcrgx"
Jul 06 19:05:54.043014 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:54.042978    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:54.136415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:54.136375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:54.136577 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:54.136388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:54.136577 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:54.136524    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:54.136711 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:54.136618    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:55.135767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.135598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:55.136505 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:55.135869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:55.383974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.383946    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:05:55.384331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.384305    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"e6138f9d659103a4184b006650f4a4e0ee60e49b1bef5a48ffa04328df1fe135"}
Jul 06 19:05:55.384577 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.384559    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:55.384767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.384752    2559 scope.go:117] "RemoveContainer" containerID="5a4a0bd9b7c8b8fb665de4766e635a9d4f6304ba9272f9871cf4d4f531aa27dc"
Jul 06 19:05:55.386255 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.386196    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="0e21cddcd50ce43de47178400dc1e64a1d7af5bb64f56064a4b99a34a3a02c3c" exitCode=0
Jul 06 19:05:55.386347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.386258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"0e21cddcd50ce43de47178400dc1e64a1d7af5bb64f56064a4b99a34a3a02c3c"}
Jul 06 19:05:55.400741 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.400720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:55.997922 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:55.997830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:56.110772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.109461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:56.135682 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.135654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:56.135682 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.135674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:56.136158 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:56.135795    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:56.136158 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:56.135957    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:56.391167 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.391137    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="c9a6c17f032079a187c5907675d61a89de4d18d58381ad865654a4c7aa3249f9" exitCode=0
Jul 06 19:05:56.391311 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.391177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"c9a6c17f032079a187c5907675d61a89de4d18d58381ad865654a4c7aa3249f9"}
Jul 06 19:05:56.395205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.395186    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:05:56.395613 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.395588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" event={"ID":"e855130e-1155-4a6e-97a4-dee6a80c2a37","Type":"ContainerStarted","Data":"93c34116b2f0a798e1df23d7b88065a5725fb4dc238ddacf034e3f325bbb5f76"}
Jul 06 19:05:56.396331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.395793    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:56.396331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.395869    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:56.411140 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.411118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:05:56.441726 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.441680    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm" podStartSLOduration=9.785442188 podStartE2EDuration="28.441665449s" totalImagesPullingTime="18.656223261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:56.440012754 +0000 UTC m=+28.872270578" watchObservedRunningTime="2026-07-06 19:05:56.441665449 +0000 UTC m=+28.873923272"
Jul 06 19:05:56.809787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.809689    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzt79"]
Jul 06 19:05:56.809953 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.809876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:56.810051 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:56.810018    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:56.811372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.811044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-526gg"]
Jul 06 19:05:56.811372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.811260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:56.811554 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:56.811430    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:56.813105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.813083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbkr6"]
Jul 06 19:05:56.813223 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:56.813210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:56.813362 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:56.813342    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:57.400341 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:57.400311    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="c1119e3018a929cc6d2443f2a9a0059ab066860e1b426e35bc93a2d6a809de08" exitCode=0
Jul 06 19:05:57.400998 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:57.400394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"c1119e3018a929cc6d2443f2a9a0059ab066860e1b426e35bc93a2d6a809de08"}
Jul 06 19:05:57.482776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:57.482714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:57.742573 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:57.742484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:57.842992 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:57.842949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.055347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.055262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.118326 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.118292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.184333 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.184301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.427507 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.427458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.480787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.480749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.642101 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.642067    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-htwtx_a31ed6f1-ba57-4a5d-b836-8001188f47aa/dns-node-resolver/0.log"
Jul 06 19:05:58.656878 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.656844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:58.716038 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:58.715957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:59.135748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.135721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:05:59.135748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.135746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:05:59.135973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.135843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:05:59.135973 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:59.135839    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:05:59.135973 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:59.135953    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:05:59.136119 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:05:59.136029    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:05:59.137384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.137354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:59.241164 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.241086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:05:59.639744 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:05:59.639716    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdcth_894f72ac-3300-45c3-ae67-92fba9f94098/node-ca/0.log"
Jul 06 19:06:00.773411 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:00.773372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:01.135973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.135939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:01.135973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.135960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:01.135973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.135967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:01.136224 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.136088    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-526gg" podUID="69c46fc9-1d8d-4884-865b-2a872cb9b7d9"
Jul 06 19:06:01.136224 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.136202    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbkr6" podUID="274ed3a2-26da-4ed1-b9e1-0db37bff9c5c"
Jul 06 19:06:01.136322 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.136304    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzt79" podUID="0e33cb85-d1d4-4f9e-be27-7edb6984fbb3"
Jul 06 19:06:01.711867 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.711834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:01.712058 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.711891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:01.712058 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712015    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:01.712058 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712041    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:06:01.712207 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs podName:69c46fc9-1d8d-4884-865b-2a872cb9b7d9 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:33.71205502 +0000 UTC m=+66.144312821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs") pod "network-metrics-daemon-526gg" (UID: "69c46fc9-1d8d-4884-865b-2a872cb9b7d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:01.712207 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712069    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:06:01.712207 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712088    2559 projected.go:196] Error preparing data for projected volume kube-api-access-wdz9m for pod openshift-network-diagnostics/network-check-target-rbkr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:01.712207 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.712137    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m podName:274ed3a2-26da-4ed1-b9e1-0db37bff9c5c nodeName:}" failed. No retries permitted until 2026-07-06 19:06:33.712120399 +0000 UTC m=+66.144378218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdz9m" (UniqueName: "kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m") pod "network-check-target-rbkr6" (UID: "274ed3a2-26da-4ed1-b9e1-0db37bff9c5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:01.742738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.742703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:01.794239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.794206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:01.813197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:01.813167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:01.813376 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.813286    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:01.813376 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:01.813341    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret podName:0e33cb85-d1d4-4f9e-be27-7edb6984fbb3 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:33.813324293 +0000 UTC m=+66.245582094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret") pod "global-pull-secret-syncer-rzt79" (UID: "0e33cb85-d1d4-4f9e-be27-7edb6984fbb3") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:02.273683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.273651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.428402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.428366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.606380 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.606205    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.699988 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.699947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.766959 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.766917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.818089 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.818004    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeReady"
Jul 06 19:06:02.818425 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:02.818132    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:06:03.132023 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.131983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:03.135437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.135413    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:03.135596 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.135512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:03.135596 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.135544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:03.138600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.138582    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:03.139856 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.139837    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:03.139856 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.139848    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:03.140030 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.139855    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqvqq\""
Jul 06 19:06:03.140030 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.139883    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:03.140030 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.139845    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h8dt\""
Jul 06 19:06:03.232525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.232485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:03.333674 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.333641    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:03.417339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.417258    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="f1ede3b268a8d965177ea090f6341bcbf629ed4e95c7bd3bd3c709d0e6da89d6" exitCode=0
Jul 06 19:06:03.417339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:03.417297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"f1ede3b268a8d965177ea090f6341bcbf629ed4e95c7bd3bd3c709d0e6da89d6"}
Jul 06 19:06:04.336772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.336738    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:04.422636 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.422601    2559 generic.go:356] "Generic (PLEG): container finished" podID="47563566-8580-4281-ade1-2b0bbc5c7a2e" containerID="3d5a9033e26dbdc55d0947b7c937b4c03650ae21e91f7612f51cb7e37195edea" exitCode=0
Jul 06 19:06:04.422789 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.422656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerDied","Data":"3d5a9033e26dbdc55d0947b7c937b4c03650ae21e91f7612f51cb7e37195edea"}
Jul 06 19:06:04.436283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.436257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:04.727701 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.727666    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:04.935348 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:04.935307    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:05.036557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.036478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:05.149940 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.149883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:05.427834 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.427804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" event={"ID":"47563566-8580-4281-ade1-2b0bbc5c7a2e","Type":"ContainerStarted","Data":"a4ce96b391478c5a1eed111072bc2ae0d88a6d002a626d633f3eefd790da9c93"}
Jul 06 19:06:05.466495 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.466430    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zhfg6" podStartSLOduration=8.137887846 podStartE2EDuration="37.466409708s" totalImagesPullingTime="29.328521862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:05.464648415 +0000 UTC m=+37.896906240" watchObservedRunningTime="2026-07-06 19:06:05.466409708 +0000 UTC m=+37.898667534"
Jul 06 19:06:05.531978 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.531923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:05.673517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.673485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:05.953610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:05.953581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.050196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:06.050166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.324484 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:06.324398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.424617 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:06.424584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.722021 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:06.721991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.825145 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:06.825108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:07.327491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:07.327461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:07.923263 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:07.923227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.023884 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:08.023846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.125619 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:08.125591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.199862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:08.199783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.321220 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:08.321180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.726141 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:08.726111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:09.330497 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:09.330462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:09.934280 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:09.934235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.125283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:10.125252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.180665 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:10.180632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.530630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:10.530595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.631219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:10.631180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.731795 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:10.731762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.000918 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:11.000880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.053114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:11.053080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.126249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:11.126216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.725219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:11.725181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:12.326363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:12.326333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:12.527082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:12.527047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:12.734175 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:12.734131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:12.936343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:12.936306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.672757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.672726    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zvd7f"]
Jul 06 19:06:23.674587 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.674571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.677233 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.677208    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mb8mb\""
Jul 06 19:06:23.677354 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.677277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:06:23.677470 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.677457    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:06:23.681474 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.681451    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9w64"]
Jul 06 19:06:23.683684 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.683667    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.686743 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.686727    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:06:23.686840 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.686804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgwxd\""
Jul 06 19:06:23.686840 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.686805    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:06:23.687287 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.687272    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:06:23.687447 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.687422    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:06:23.691069 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.691047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zvd7f"]
Jul 06 19:06:23.699595 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.699568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9w64"]
Jul 06 19:06:23.765286 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.765254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.775306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.775306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbcn\" (UniqueName: \"kubernetes.io/projected/526c6187-ef19-467b-812f-152bddb60ddb-kube-api-access-bzbcn\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.775480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d904744-185e-41d8-bbe1-4ec67af6da71-crio-socket\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.775480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d904744-185e-41d8-bbe1-4ec67af6da71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.775480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526c6187-ef19-467b-812f-152bddb60ddb-tmp-dir\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.775575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d904744-185e-41d8-bbe1-4ec67af6da71-data-volume\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.775575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdbd2\" (UniqueName: \"kubernetes.io/projected/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-api-access-rdbd2\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.775575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/526c6187-ef19-467b-812f-152bddb60ddb-config-volume\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.775661 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.775584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/526c6187-ef19-467b-812f-152bddb60ddb-metrics-tls\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.781844 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.781818    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ckhgv"]
Jul 06 19:06:23.783770 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.783751    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-846d9ff779-jvhjf"]
Jul 06 19:06:23.783896 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.783882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.785395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.785380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"]
Jul 06 19:06:23.785528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.785510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.786736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.786720    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6qj8k\""
Jul 06 19:06:23.786922 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.786908    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:06:23.786997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.786978    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.787110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.786979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:06:23.787219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.787193    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:06:23.788957 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.788921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:06:23.788957 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.788952    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dj2cn\""
Jul 06 19:06:23.791433 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.791418    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:06:23.793205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.793190    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:06:23.793836 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.793820    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qvw6j\""
Jul 06 19:06:23.794045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.794031    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:06:23.794738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.794726    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:06:23.795027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.795011    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:06:23.795595 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.795580    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:06:23.800317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.800299    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:06:23.802790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.802772    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"]
Jul 06 19:06:23.807289 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.807269    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckhgv"]
Jul 06 19:06:23.812500 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.812477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846d9ff779-jvhjf"]
Jul 06 19:06:23.866731 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.866695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.876319 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-bound-sa-token\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.876427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbcn\" (UniqueName: \"kubernetes.io/projected/526c6187-ef19-467b-812f-152bddb60ddb-kube-api-access-bzbcn\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.876427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-registry-tls\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtd5\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-kube-api-access-dgtd5\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d904744-185e-41d8-bbe1-4ec67af6da71-crio-socket\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.876622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-image-registry-private-configuration\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01f2f437-db5e-4126-ab43-6a27ffeab520-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.876622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876578    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d904744-185e-41d8-bbe1-4ec67af6da71-crio-socket\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.876622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d904744-185e-41d8-bbe1-4ec67af6da71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-installation-pull-secrets\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8cj2\" (UniqueName: \"kubernetes.io/projected/f85e50e9-94b1-411d-981d-06e349345c23-kube-api-access-b8cj2\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526c6187-ef19-467b-812f-152bddb60ddb-tmp-dir\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aefce113-82ea-4588-b363-2554df4572ba-ca-trust-extracted\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-registry-certificates\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-trusted-ca\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d904744-185e-41d8-bbe1-4ec67af6da71-data-volume\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.876857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85e50e9-94b1-411d-981d-06e349345c23-cert\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdbd2\" (UniqueName: \"kubernetes.io/projected/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-api-access-rdbd2\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxk5\" (UniqueName: \"kubernetes.io/projected/01f2f437-db5e-4126-ab43-6a27ffeab520-kube-api-access-4mxk5\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.876976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/526c6187-ef19-467b-812f-152bddb60ddb-config-volume\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.877000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/526c6187-ef19-467b-812f-152bddb60ddb-metrics-tls\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.877045    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/526c6187-ef19-467b-812f-152bddb60ddb-tmp-dir\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.877059    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.877210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.877186    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d904744-185e-41d8-bbe1-4ec67af6da71-data-volume\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.877454 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.877438    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/526c6187-ef19-467b-812f-152bddb60ddb-config-volume\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.880570 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.880549    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/526c6187-ef19-467b-812f-152bddb60ddb-metrics-tls\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.880666 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.880587    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d904744-185e-41d8-bbe1-4ec67af6da71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.892517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.892493    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbcn\" (UniqueName: \"kubernetes.io/projected/526c6187-ef19-467b-812f-152bddb60ddb-kube-api-access-bzbcn\") pod \"dns-default-zvd7f\" (UID: \"526c6187-ef19-467b-812f-152bddb60ddb\") " pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.892608 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.892519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdbd2\" (UniqueName: \"kubernetes.io/projected/9d904744-185e-41d8-bbe1-4ec67af6da71-kube-api-access-rdbd2\") pod \"insights-runtime-extractor-k9w64\" (UID: \"9d904744-185e-41d8-bbe1-4ec67af6da71\") " pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:23.972909 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.972818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.977796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-bound-sa-token\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.977893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-registry-tls\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.977893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtd5\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-kube-api-access-dgtd5\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.977893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-image-registry-private-configuration\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.977893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01f2f437-db5e-4126-ab43-6a27ffeab520-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.978119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.977893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-installation-pull-secrets\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.978119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8cj2\" (UniqueName: \"kubernetes.io/projected/f85e50e9-94b1-411d-981d-06e349345c23-kube-api-access-b8cj2\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.978119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aefce113-82ea-4588-b363-2554df4572ba-ca-trust-extracted\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.978119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-registry-certificates\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.978303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-trusted-ca\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.978303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85e50e9-94b1-411d-981d-06e349345c23-cert\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.978303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxk5\" (UniqueName: \"kubernetes.io/projected/01f2f437-db5e-4126-ab43-6a27ffeab520-kube-api-access-4mxk5\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.978620 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.978588    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aefce113-82ea-4588-b363-2554df4572ba-ca-trust-extracted\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.979109 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.979050    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-registry-certificates\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.979331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.979312    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aefce113-82ea-4588-b363-2554df4572ba-trusted-ca\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.980658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.980633    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-registry-tls\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.980796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.980775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-image-registry-private-configuration\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.980876 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.980860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aefce113-82ea-4588-b363-2554df4572ba-installation-pull-secrets\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.981004 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.980984    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01f2f437-db5e-4126-ab43-6a27ffeab520-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.981048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.981019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85e50e9-94b1-411d-981d-06e349345c23-cert\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:23.983854 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.983837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:23.991868 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.991851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxk5\" (UniqueName: \"kubernetes.io/projected/01f2f437-db5e-4126-ab43-6a27ffeab520-kube-api-access-4mxk5\") pod \"managed-serviceaccount-addon-agent-6769b4d44-4sh25\" (UID: \"01f2f437-db5e-4126-ab43-6a27ffeab520\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:23.992765 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.992741    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtd5\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-kube-api-access-dgtd5\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:23.993505 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:23.993488    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9w64"
Jul 06 19:06:24.000367 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.000345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aefce113-82ea-4588-b363-2554df4572ba-bound-sa-token\") pod \"image-registry-846d9ff779-jvhjf\" (UID: \"aefce113-82ea-4588-b363-2554df4572ba\") " pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:24.000519 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.000503    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8cj2\" (UniqueName: \"kubernetes.io/projected/f85e50e9-94b1-411d-981d-06e349345c23-kube-api-access-b8cj2\") pod \"ingress-canary-ckhgv\" (UID: \"f85e50e9-94b1-411d-981d-06e349345c23\") " pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:24.072736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.070460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:24.094303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.094267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckhgv"
Jul 06 19:06:24.102471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.102294    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:24.117317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.117225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"
Jul 06 19:06:24.151611 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.151580    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zvd7f"]
Jul 06 19:06:24.157301 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:24.156137    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526c6187_ef19_467b_812f_152bddb60ddb.slice/crio-680a2dd1dc33a422e1f554f0046031663f6f9be32c4a26568dfd69be19face45 WatchSource:0}: Error finding container 680a2dd1dc33a422e1f554f0046031663f6f9be32c4a26568dfd69be19face45: Status 404 returned error can't find the container with id 680a2dd1dc33a422e1f554f0046031663f6f9be32c4a26568dfd69be19face45
Jul 06 19:06:24.178049 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.178017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9w64"]
Jul 06 19:06:24.253213 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.253181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckhgv"]
Jul 06 19:06:24.255811 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:24.255779    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85e50e9_94b1_411d_981d_06e349345c23.slice/crio-9b2998ff7730fa35faabfeb854f3a38261898980880f495c2c41cc271db5544e WatchSource:0}: Error finding container 9b2998ff7730fa35faabfeb854f3a38261898980880f495c2c41cc271db5544e: Status 404 returned error can't find the container with id 9b2998ff7730fa35faabfeb854f3a38261898980880f495c2c41cc271db5544e
Jul 06 19:06:24.268126 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.268100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846d9ff779-jvhjf"]
Jul 06 19:06:24.270661 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:24.270631    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefce113_82ea_4588_b363_2554df4572ba.slice/crio-902683bf57e2c288b0106002f24cbcd1f27b758abd562771aec94b5fd8ae1b8b WatchSource:0}: Error finding container 902683bf57e2c288b0106002f24cbcd1f27b758abd562771aec94b5fd8ae1b8b: Status 404 returned error can't find the container with id 902683bf57e2c288b0106002f24cbcd1f27b758abd562771aec94b5fd8ae1b8b
Jul 06 19:06:24.283836 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.283813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25"]
Jul 06 19:06:24.286558 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:24.286534    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01f2f437_db5e_4126_ab43_6a27ffeab520.slice/crio-96f41eb509301bb9a72efeb6f8563b4d373b280e788bf36626769e1d2d120ac5 WatchSource:0}: Error finding container 96f41eb509301bb9a72efeb6f8563b4d373b280e788bf36626769e1d2d120ac5: Status 404 returned error can't find the container with id 96f41eb509301bb9a72efeb6f8563b4d373b280e788bf36626769e1d2d120ac5
Jul 06 19:06:24.472283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.472245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9w64" event={"ID":"9d904744-185e-41d8-bbe1-4ec67af6da71","Type":"ContainerStarted","Data":"750ca2dc72e72062d8f069560414b8508fd150868b68cd39c94b1350f3b02c13"}
Jul 06 19:06:24.473363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.473334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25" event={"ID":"01f2f437-db5e-4126-ab43-6a27ffeab520","Type":"ContainerStarted","Data":"96f41eb509301bb9a72efeb6f8563b4d373b280e788bf36626769e1d2d120ac5"}
Jul 06 19:06:24.474748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.474726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf" event={"ID":"aefce113-82ea-4588-b363-2554df4572ba","Type":"ContainerStarted","Data":"2f83efb980044f083f055852e1a2c982458dcf02d838d0d63d41f67c10d8a6da"}
Jul 06 19:06:24.474881 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.474764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf" event={"ID":"aefce113-82ea-4588-b363-2554df4572ba","Type":"ContainerStarted","Data":"902683bf57e2c288b0106002f24cbcd1f27b758abd562771aec94b5fd8ae1b8b"}
Jul 06 19:06:24.474962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.474945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:24.475837 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.475814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckhgv" event={"ID":"f85e50e9-94b1-411d-981d-06e349345c23","Type":"ContainerStarted","Data":"9b2998ff7730fa35faabfeb854f3a38261898980880f495c2c41cc271db5544e"}
Jul 06 19:06:24.476898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.476876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvd7f" event={"ID":"526c6187-ef19-467b-812f-152bddb60ddb","Type":"ContainerStarted","Data":"680a2dd1dc33a422e1f554f0046031663f6f9be32c4a26568dfd69be19face45"}
Jul 06 19:06:24.495560 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:24.495454    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf" podStartSLOduration=1.495434004 podStartE2EDuration="1.495434004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:24.494320599 +0000 UTC m=+56.926578419" watchObservedRunningTime="2026-07-06 19:06:24.495434004 +0000 UTC m=+56.927691829"
Jul 06 19:06:26.357721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.357685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.463323 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.463290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.535851 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.535810    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"]
Jul 06 19:06:26.537336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.537306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.538647 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.538618    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:26.541284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.541266    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 19:06:26.541385 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.541365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v427h\""
Jul 06 19:06:26.546479 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.546425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"]
Jul 06 19:06:26.603434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.603398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/376367bf-a9f0-46f0-90fb-3c1952560070-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cjfst\" (UID: \"376367bf-a9f0-46f0-90fb-3c1952560070\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:26.704788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.704731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/376367bf-a9f0-46f0-90fb-3c1952560070-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cjfst\" (UID: \"376367bf-a9f0-46f0-90fb-3c1952560070\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:26.707788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.707758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/376367bf-a9f0-46f0-90fb-3c1952560070-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-cjfst\" (UID: \"376367bf-a9f0-46f0-90fb-3c1952560070\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:26.765039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.765002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.828151 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.828076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.850139 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.850097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:26.928749 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:26.928711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:27.031068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:27.030987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:27.091844 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:27.091788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:28.414120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:28.414089    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfhdm"
Jul 06 19:06:28.534829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:28.534785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:28.590607 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:28.590572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:30.293178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:30.293140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:30.394704 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:30.394665    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:30.823439 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:30.823398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"]
Jul 06 19:06:30.828591 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:30.828537    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376367bf_a9f0_46f0_90fb_3c1952560070.slice/crio-78e4598b5f7835ecc90ef865b2bdd09c7f43941893cf566f5c1f6481afec846a WatchSource:0}: Error finding container 78e4598b5f7835ecc90ef865b2bdd09c7f43941893cf566f5c1f6481afec846a: Status 404 returned error can't find the container with id 78e4598b5f7835ecc90ef865b2bdd09c7f43941893cf566f5c1f6481afec846a
Jul 06 19:06:31.501785 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.501754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvd7f" event={"ID":"526c6187-ef19-467b-812f-152bddb60ddb","Type":"ContainerStarted","Data":"85034370ebb02e675ff327b0839a4b481b27b5e2b7a8814ecdbb704b1f5eca61"}
Jul 06 19:06:31.502216 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.501805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zvd7f" event={"ID":"526c6187-ef19-467b-812f-152bddb60ddb","Type":"ContainerStarted","Data":"df31478592f3d6fb10bd103892ee8e7a1a6ab0b15377269456a5fefebd2701c7"}
Jul 06 19:06:31.502216 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.501858    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:31.503546 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.503525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9w64" event={"ID":"9d904744-185e-41d8-bbe1-4ec67af6da71","Type":"ContainerStarted","Data":"44bf133b48f6e2f09f39483eefd83aff23bd6f0494d706420cf3165fafed4ac6"}
Jul 06 19:06:31.503670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.503565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9w64" event={"ID":"9d904744-185e-41d8-bbe1-4ec67af6da71","Type":"ContainerStarted","Data":"f000ee810fa59cfa6076ce00614004f90c3541046c828d037dbd4d42932a0b72"}
Jul 06 19:06:31.504810 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.504792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25" event={"ID":"01f2f437-db5e-4126-ab43-6a27ffeab520","Type":"ContainerStarted","Data":"971b230e018579598f00cafb9d64822a6cf9d55f999b65ec937e304ef52d9a50"}
Jul 06 19:06:31.505832 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.505811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst" event={"ID":"376367bf-a9f0-46f0-90fb-3c1952560070","Type":"ContainerStarted","Data":"78e4598b5f7835ecc90ef865b2bdd09c7f43941893cf566f5c1f6481afec846a"}
Jul 06 19:06:31.507096 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.507076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckhgv" event={"ID":"f85e50e9-94b1-411d-981d-06e349345c23","Type":"ContainerStarted","Data":"15789c6d2b58c1a9904038e60f38a39eef7bc6998c06feac3f657017a18a1ffc"}
Jul 06 19:06:31.521325 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.521285    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zvd7f" podStartSLOduration=2.001618538 podStartE2EDuration="8.521272786s" totalImagesPullingTime="6.519654248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.51978643 +0000 UTC m=+63.952044254" watchObservedRunningTime="2026-07-06 19:06:31.521272786 +0000 UTC m=+63.953530610"
Jul 06 19:06:31.535308 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.535267    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769b4d44-4sh25" podStartSLOduration=2.15151155 podStartE2EDuration="8.535254102s" totalImagesPullingTime="6.383742552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.534981499 +0000 UTC m=+63.967239325" watchObservedRunningTime="2026-07-06 19:06:31.535254102 +0000 UTC m=+63.967511903"
Jul 06 19:06:31.555266 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.555223    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ckhgv" podStartSLOduration=2.134160614 podStartE2EDuration="8.555207951s" totalImagesPullingTime="6.421047337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.554570946 +0000 UTC m=+63.986828804" watchObservedRunningTime="2026-07-06 19:06:31.555207951 +0000 UTC m=+63.987465774"
Jul 06 19:06:31.625077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.625046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:31.676233 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:31.676199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:32.512437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:32.512336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst" event={"ID":"376367bf-a9f0-46f0-90fb-3c1952560070","Type":"ContainerStarted","Data":"afa5007006c9f1528330bb605ae35b276014aa5f3790679558c0d8f5fdaf4e0c"}
Jul 06 19:06:32.530379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:32.530323    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst" podStartSLOduration=5.107448554 podStartE2EDuration="6.530302458s" totalImagesPullingTime="1.422853904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:32.528845844 +0000 UTC m=+64.961103696" watchObservedRunningTime="2026-07-06 19:06:32.530302458 +0000 UTC m=+64.962560284"
Jul 06 19:06:32.900427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:32.900392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:32.966163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:32.966129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:33.516436 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.516405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:33.521888 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.521860    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-cjfst"
Jul 06 19:06:33.774014 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.773915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:33.774014 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.773992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:33.776838 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.776808    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:33.778117 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.778100    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:33.786943 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.786910    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69c46fc9-1d8d-4884-865b-2a872cb9b7d9-metrics-certs\") pod \"network-metrics-daemon-526gg\" (UID: \"69c46fc9-1d8d-4884-865b-2a872cb9b7d9\") " pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:33.787205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.787186    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:33.798107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.798078    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdz9m\" (UniqueName: \"kubernetes.io/projected/274ed3a2-26da-4ed1-b9e1-0db37bff9c5c-kube-api-access-wdz9m\") pod \"network-check-target-rbkr6\" (UID: \"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c\") " pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:33.875276 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.875239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:33.878302 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.878279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:33.888414 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:33.888390    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e33cb85-d1d4-4f9e-be27-7edb6984fbb3-original-pull-secret\") pod \"global-pull-secret-syncer-rzt79\" (UID: \"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3\") " pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:34.048804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.048731    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lqvqq\""
Jul 06 19:06:34.053626 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.053608    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h8dt\""
Jul 06 19:06:34.055729 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.055713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzt79"
Jul 06 19:06:34.056980 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.056964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-526gg"
Jul 06 19:06:34.061095 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.061082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:34.305635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.305538    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzt79"]
Jul 06 19:06:34.309165 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:34.309133    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e33cb85_d1d4_4f9e_be27_7edb6984fbb3.slice/crio-0c417eae1c51778bf570c6a7ad0241c805b17fae8a08bfcd32f5f03921df3ff8 WatchSource:0}: Error finding container 0c417eae1c51778bf570c6a7ad0241c805b17fae8a08bfcd32f5f03921df3ff8: Status 404 returned error can't find the container with id 0c417eae1c51778bf570c6a7ad0241c805b17fae8a08bfcd32f5f03921df3ff8
Jul 06 19:06:34.521438 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.521402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9w64" event={"ID":"9d904744-185e-41d8-bbe1-4ec67af6da71","Type":"ContainerStarted","Data":"b7eb809ac28f6dea893d3c751787d333116d9671961ed2689ea46ea4e2c1a513"}
Jul 06 19:06:34.522634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.522611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzt79" event={"ID":"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3","Type":"ContainerStarted","Data":"0c417eae1c51778bf570c6a7ad0241c805b17fae8a08bfcd32f5f03921df3ff8"}
Jul 06 19:06:34.530013 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.529990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbkr6"]
Jul 06 19:06:34.533237 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.533211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-526gg"]
Jul 06 19:06:34.533352 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:34.533260    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274ed3a2_26da_4ed1_b9e1_0db37bff9c5c.slice/crio-83018eedcd3722b254f208435089739b53656400c8bf337e57197c68195fe149 WatchSource:0}: Error finding container 83018eedcd3722b254f208435089739b53656400c8bf337e57197c68195fe149: Status 404 returned error can't find the container with id 83018eedcd3722b254f208435089739b53656400c8bf337e57197c68195fe149
Jul 06 19:06:34.537449 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:34.537429    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c46fc9_1d8d_4884_865b_2a872cb9b7d9.slice/crio-53d49e1886fa4849ef390d7d3a44b46f2b1c9950912480a0afe360450fd9dd58 WatchSource:0}: Error finding container 53d49e1886fa4849ef390d7d3a44b46f2b1c9950912480a0afe360450fd9dd58: Status 404 returned error can't find the container with id 53d49e1886fa4849ef390d7d3a44b46f2b1c9950912480a0afe360450fd9dd58
Jul 06 19:06:34.542809 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.542767    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9w64" podStartSLOduration=1.522565611 podStartE2EDuration="11.542750267s" totalImagesPullingTime="10.020184656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:34.542355094 +0000 UTC m=+66.974612940" watchObservedRunningTime="2026-07-06 19:06:34.542750267 +0000 UTC m=+66.975008090"
Jul 06 19:06:34.564516 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.564437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:34.605533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.605504    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"]
Jul 06 19:06:34.608196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.608180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.611095 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611073    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 19:06:34.611320 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611301    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:06:34.611320 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611309    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:06:34.611487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611325    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 19:06:34.611487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611404    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:06:34.611487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.611433    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-d4964\""
Jul 06 19:06:34.618204 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.618184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"]
Jul 06 19:06:34.640241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.640212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:34.682642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.682607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.682642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.682645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.682843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.682666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce78a006-8dda-48f8-866c-2abcee998304-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.682843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.682757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjx75\" (UniqueName: \"kubernetes.io/projected/ce78a006-8dda-48f8-866c-2abcee998304-kube-api-access-mjx75\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.783135 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.783087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjx75\" (UniqueName: \"kubernetes.io/projected/ce78a006-8dda-48f8-866c-2abcee998304-kube-api-access-mjx75\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.783312 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.783170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.783312 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.783203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.783312 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.783233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce78a006-8dda-48f8-866c-2abcee998304-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.783434 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:34.783311    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 19:06:34.783434 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:34.783385    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls podName:ce78a006-8dda-48f8-866c-2abcee998304 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:35.283364772 +0000 UTC m=+67.715622591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-khwbf" (UID: "ce78a006-8dda-48f8-866c-2abcee998304") : secret "prometheus-operator-tls" not found
Jul 06 19:06:34.783876 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.783860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce78a006-8dda-48f8-866c-2abcee998304-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.785534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.785517    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:34.793968 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:34.793943    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjx75\" (UniqueName: \"kubernetes.io/projected/ce78a006-8dda-48f8-866c-2abcee998304-kube-api-access-mjx75\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:35.040219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.040164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:35.287805 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.287189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:35.290570 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.290498    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce78a006-8dda-48f8-866c-2abcee998304-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-khwbf\" (UID: \"ce78a006-8dda-48f8-866c-2abcee998304\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:35.517669 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.517587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"
Jul 06 19:06:35.529322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.529288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbkr6" event={"ID":"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c","Type":"ContainerStarted","Data":"83018eedcd3722b254f208435089739b53656400c8bf337e57197c68195fe149"}
Jul 06 19:06:35.531515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.531485    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-526gg" event={"ID":"69c46fc9-1d8d-4884-865b-2a872cb9b7d9","Type":"ContainerStarted","Data":"53d49e1886fa4849ef390d7d3a44b46f2b1c9950912480a0afe360450fd9dd58"}
Jul 06 19:06:35.703152 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:35.703071    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf"]
Jul 06 19:06:35.705247 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:35.705217    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce78a006_8dda_48f8_866c_2abcee998304.slice/crio-58243bf22d744cbfc5d2d49bec770d958f828ae2c1b04c6921d8d20090181cc7 WatchSource:0}: Error finding container 58243bf22d744cbfc5d2d49bec770d958f828ae2c1b04c6921d8d20090181cc7: Status 404 returned error can't find the container with id 58243bf22d744cbfc5d2d49bec770d958f828ae2c1b04c6921d8d20090181cc7
Jul 06 19:06:36.538600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:36.538543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-526gg" event={"ID":"69c46fc9-1d8d-4884-865b-2a872cb9b7d9","Type":"ContainerStarted","Data":"9b3722c68fdc8b9e0344d313714786624587aaee448d9250106c78586c483a28"}
Jul 06 19:06:36.539159 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:36.538625    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-526gg" event={"ID":"69c46fc9-1d8d-4884-865b-2a872cb9b7d9","Type":"ContainerStarted","Data":"345bd344e3fe30fbc372a4b3f3a1874c8c1ca54722c4593aadf943afce11d323"}
Jul 06 19:06:36.540572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:36.540541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf" event={"ID":"ce78a006-8dda-48f8-866c-2abcee998304","Type":"ContainerStarted","Data":"58243bf22d744cbfc5d2d49bec770d958f828ae2c1b04c6921d8d20090181cc7"}
Jul 06 19:06:36.645056 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:36.645013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:36.746729 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:36.746668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:39.362919 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.362887    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:39.424061 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.424035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:39.558477 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.558443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf" event={"ID":"ce78a006-8dda-48f8-866c-2abcee998304","Type":"ContainerStarted","Data":"3fdd360fc1e1f4f81fae3012364b4e6927070e7e3f8a70faec1a2a25123f0631"}
Jul 06 19:06:39.560217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.560191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbkr6" event={"ID":"274ed3a2-26da-4ed1-b9e1-0db37bff9c5c","Type":"ContainerStarted","Data":"84321408b2346d6d7dfa9aa920887f70216c09581735ade6b51dedc4ca520ec7"}
Jul 06 19:06:39.560339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.560292    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:06:39.577451 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.577257    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-526gg" podStartSLOduration=70.529253761 podStartE2EDuration="1m11.577236838s" totalImagesPullingTime="1.047983077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:36.555315198 +0000 UTC m=+68.987573045" watchObservedRunningTime="2026-07-06 19:06:39.577236838 +0000 UTC m=+72.009494662"
Jul 06 19:06:39.577451 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.577439    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbkr6" podStartSLOduration=66.689597413 podStartE2EDuration="1m11.577425668s" totalImagesPullingTime="4.887828255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:39.576910017 +0000 UTC m=+72.009167866" watchObservedRunningTime="2026-07-06 19:06:39.577425668 +0000 UTC m=+72.009683496"
Jul 06 19:06:39.700528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:39.700435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:40.564885 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:40.564851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzt79" event={"ID":"0e33cb85-d1d4-4f9e-be27-7edb6984fbb3","Type":"ContainerStarted","Data":"5def21b0bb6ddc1848cc8e3b317fcaf27ab615cdb1a0d620a04cc6cc876e9647"}
Jul 06 19:06:40.566672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:40.566646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf" event={"ID":"ce78a006-8dda-48f8-866c-2abcee998304","Type":"ContainerStarted","Data":"8b5694144c119cfa198f1ac2445469ffaab45e0a26f44e78562d3238d0319b29"}
Jul 06 19:06:40.585377 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:40.585332    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rzt79" podStartSLOduration=67.458619213 podStartE2EDuration="1m12.585315947s" totalImagesPullingTime="5.126696734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:40.584375589 +0000 UTC m=+73.016633414" watchObservedRunningTime="2026-07-06 19:06:40.585315947 +0000 UTC m=+73.017573770"
Jul 06 19:06:40.601344 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:40.601300    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-khwbf" podStartSLOduration=2.885356597 podStartE2EDuration="6.601285471s" totalImagesPullingTime="3.715928874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:40.600243092 +0000 UTC m=+73.032500926" watchObservedRunningTime="2026-07-06 19:06:40.601285471 +0000 UTC m=+73.033543296"
Jul 06 19:06:41.515011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:41.514981    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zvd7f"
Jul 06 19:06:42.079371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.079329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:42.130635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.130601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:42.709225 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.709191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:42.956178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.956144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:42.960363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.960302    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"]
Jul 06 19:06:42.963305 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.963287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:42.966249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.966222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 19:06:42.966329 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.966222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:06:42.966621 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.966604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vn8hf\""
Jul 06 19:06:42.973583 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.973556    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"]
Jul 06 19:06:42.976149 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.976123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:42.977811 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.977790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"]
Jul 06 19:06:42.979447 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.979431    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6dzkk\""
Jul 06 19:06:42.979838 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.979819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:06:42.980090 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.980063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:06:42.980090 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.980085    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:06:42.992361 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.992328    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-slqsq"]
Jul 06 19:06:42.995751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.995725    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"]
Jul 06 19:06:42.995871 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.995844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:42.998794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.998774    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hp6cr\""
Jul 06 19:06:42.999097 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.999077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:06:42.999374 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.999359    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:06:42.999515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:42.999500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:06:43.045262 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d015adb-b261-4cdf-a0b7-750890dd1098-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.045262 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.045512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.045512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qz86\" (UniqueName: \"kubernetes.io/projected/28721649-2582-4cd5-96d7-c7ee50f830be-kube-api-access-2qz86\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.045512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28721649-2582-4cd5-96d7-c7ee50f830be-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.045512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pt8w\" (UniqueName: \"kubernetes.io/projected/2d015adb-b261-4cdf-a0b7-750890dd1098-kube-api-access-4pt8w\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.045512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.045757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.045757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.045757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.045683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.055098 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.055067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.146629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pt8w\" (UniqueName: \"kubernetes.io/projected/2d015adb-b261-4cdf-a0b7-750890dd1098-kube-api-access-4pt8w\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.146629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-root\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:43.146921    2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.146977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:43.147006    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls podName:2d015adb-b261-4cdf-a0b7-750890dd1098 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:43.646986168 +0000 UTC m=+76.079243984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-5qqpd" (UID: "2d015adb-b261-4cdf-a0b7-750890dd1098") : secret "openshift-state-metrics-tls" not found
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d015adb-b261-4cdf-a0b7-750890dd1098-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-metrics-client-ca\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qz86\" (UniqueName: \"kubernetes.io/projected/28721649-2582-4cd5-96d7-c7ee50f830be-kube-api-access-2qz86\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-tls\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6zw\" (UniqueName: \"kubernetes.io/projected/b0e347ee-189d-4298-bf8e-1ae63ee37e64-kube-api-access-9x6zw\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-textfile\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-sys\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-wtmp\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28721649-2582-4cd5-96d7-c7ee50f830be-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:43.147054    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 06 19:06:43.147610 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:43.147497    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls podName:28721649-2582-4cd5-96d7-c7ee50f830be nodeName:}" failed. No retries permitted until 2026-07-06 19:06:43.647476933 +0000 UTC m=+76.079734749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mdsjl" (UID: "28721649-2582-4cd5-96d7-c7ee50f830be") : secret "kube-state-metrics-tls" not found
Jul 06 19:06:43.148215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.148215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147857    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.148215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.147861    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d015adb-b261-4cdf-a0b7-750890dd1098-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.148215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.148016    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/28721649-2582-4cd5-96d7-c7ee50f830be-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.148215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.148181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.149402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.149380    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.149600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.149583    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.157375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.157354    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pt8w\" (UniqueName: \"kubernetes.io/projected/2d015adb-b261-4cdf-a0b7-750890dd1098-kube-api-access-4pt8w\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.161191 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.161172    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qz86\" (UniqueName: \"kubernetes.io/projected/28721649-2582-4cd5-96d7-c7ee50f830be-kube-api-access-2qz86\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.248437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-metrics-client-ca\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-tls\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6zw\" (UniqueName: \"kubernetes.io/projected/b0e347ee-189d-4298-bf8e-1ae63ee37e64-kube-api-access-9x6zw\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248646 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-textfile\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248694 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-sys\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248749 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248716    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-sys\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248749 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-wtmp\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-root\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-wtmp\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248981 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248981 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248981 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248918    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0e347ee-189d-4298-bf8e-1ae63ee37e64-root\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.248981 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.248962    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-textfile\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.249123 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.249020    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-metrics-client-ca\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.249363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.249345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.250786 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.250765    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-tls\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.250984 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.250967    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0e347ee-189d-4298-bf8e-1ae63ee37e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.257004 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.256979    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6zw\" (UniqueName: \"kubernetes.io/projected/b0e347ee-189d-4298-bf8e-1ae63ee37e64-kube-api-access-9x6zw\") pod \"node-exporter-slqsq\" (UID: \"b0e347ee-189d-4298-bf8e-1ae63ee37e64\") " pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.305547 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.305512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slqsq"
Jul 06 19:06:43.316241 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:43.316211    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e347ee_189d_4298_bf8e_1ae63ee37e64.slice/crio-7c0a474488c8676405f5f52a253e519cd65f125f279a873431b04212d8f07b7f WatchSource:0}: Error finding container 7c0a474488c8676405f5f52a253e519cd65f125f279a873431b04212d8f07b7f: Status 404 returned error can't find the container with id 7c0a474488c8676405f5f52a253e519cd65f125f279a873431b04212d8f07b7f
Jul 06 19:06:43.316354 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.316248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.416191 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.416152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.476145 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.476113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.577892 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.577808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slqsq" event={"ID":"b0e347ee-189d-4298-bf8e-1ae63ee37e64","Type":"ContainerStarted","Data":"7c0a474488c8676405f5f52a253e519cd65f125f279a873431b04212d8f07b7f"}
Jul 06 19:06:43.603037 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.603003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.652442 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.652408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.652590 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.652493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.654967 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.654942    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d015adb-b261-4cdf-a0b7-750890dd1098-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5qqpd\" (UID: \"2d015adb-b261-4cdf-a0b7-750890dd1098\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.655068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.654978    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/28721649-2582-4cd5-96d7-c7ee50f830be-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mdsjl\" (UID: \"28721649-2582-4cd5-96d7-c7ee50f830be\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.764552 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.764512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:43.871728 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.871680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"
Jul 06 19:06:43.885782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.885760    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"
Jul 06 19:06:43.951555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:43.951522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:44.034720 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.034680    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:06:44.039115 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.039031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:44.041314 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.039788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.041314 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.041220    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.044484    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.044735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.045063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.045258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.045459    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.045759    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.045963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.046194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.046383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n2x6g\""
Jul 06 19:06:44.048065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.047722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 19:06:44.058525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.058489    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd"]
Jul 06 19:06:44.076694 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.076664    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl"]
Jul 06 19:06:44.079981 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:44.079947    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28721649_2582_4cd5_96d7_c7ee50f830be.slice/crio-87de563529b3b1c9c652b1d2076febfc4fad34865d5dbb810d38a190986387ac WatchSource:0}: Error finding container 87de563529b3b1c9c652b1d2076febfc4fad34865d5dbb810d38a190986387ac: Status 404 returned error can't find the container with id 87de563529b3b1c9c652b1d2076febfc4fad34865d5dbb810d38a190986387ac
Jul 06 19:06:44.157751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.157954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.158007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.158056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.158090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.158117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbdlv\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.158685 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.158180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.258907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.259215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.259215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.258992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.259215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.259022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.259215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.259048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbdlv\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.259215 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.259048    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.260084 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.259627    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.260084 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:44.259788    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle podName:e471abb6-8f72-4e82-abc8-ccc8ddcda59a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:44.759767365 +0000 UTC m=+77.192025169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a") : configmap references non-existent config key: ca-bundle.crt
Jul 06 19:06:44.260084 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:44.259843    2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 19:06:44.260084 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:44.259898    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls podName:e471abb6-8f72-4e82-abc8-ccc8ddcda59a nodeName:}" failed. No retries permitted until 2026-07-06 19:06:44.759880672 +0000 UTC m=+77.192138485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a") : secret "alertmanager-main-tls" not found
Jul 06 19:06:44.261797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.261775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.261797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.261791    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.261987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.261890    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.262534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.262511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.262892 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.262866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.263001 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.262876    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.263133 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.263116    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.263406 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.263386    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.270229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.270208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbdlv\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.370022 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.369814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:44.583394 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.583307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl" event={"ID":"28721649-2582-4cd5-96d7-c7ee50f830be","Type":"ContainerStarted","Data":"87de563529b3b1c9c652b1d2076febfc4fad34865d5dbb810d38a190986387ac"}
Jul 06 19:06:44.589259 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.589218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd" event={"ID":"2d015adb-b261-4cdf-a0b7-750890dd1098","Type":"ContainerStarted","Data":"e561a8c46ea3fdd8b6c428b637d83cc13d8070d7de359b168710a1aff0030666"}
Jul 06 19:06:44.589417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.589305    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd" event={"ID":"2d015adb-b261-4cdf-a0b7-750890dd1098","Type":"ContainerStarted","Data":"907e6cdce387a82c76cab0accec1c3ca788ff3f4b39b89af34abd891dfc028fc"}
Jul 06 19:06:44.589417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.589332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd" event={"ID":"2d015adb-b261-4cdf-a0b7-750890dd1098","Type":"ContainerStarted","Data":"742545d7a19745fe516eab76e53471846f9f0b3039d617b4011e39b180f5adec"}
Jul 06 19:06:44.763318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.763282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.763480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.763330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.764120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.764091    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.765777 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.765751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:44.959108 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:44.959074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:06:45.103169 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.102819    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:06:45.105617 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:45.105570    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode471abb6_8f72_4e82_abc8_ccc8ddcda59a.slice/crio-e2c8b61eaf3cee8d2e6f00ae6799ee4dc3028678943e35e2be5af1a9b9813631 WatchSource:0}: Error finding container e2c8b61eaf3cee8d2e6f00ae6799ee4dc3028678943e35e2be5af1a9b9813631: Status 404 returned error can't find the container with id e2c8b61eaf3cee8d2e6f00ae6799ee4dc3028678943e35e2be5af1a9b9813631
Jul 06 19:06:45.490185 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.490152    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-846d9ff779-jvhjf"
Jul 06 19:06:45.594309 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.594280    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0e347ee-189d-4298-bf8e-1ae63ee37e64" containerID="7080130c48052d7890426a6d366f204652919ceb851eb2063f5573c0c7bda1ec" exitCode=0
Jul 06 19:06:45.594426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.594377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slqsq" event={"ID":"b0e347ee-189d-4298-bf8e-1ae63ee37e64","Type":"ContainerDied","Data":"7080130c48052d7890426a6d366f204652919ceb851eb2063f5573c0c7bda1ec"}
Jul 06 19:06:45.595677 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.595655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"e2c8b61eaf3cee8d2e6f00ae6799ee4dc3028678943e35e2be5af1a9b9813631"}
Jul 06 19:06:45.609952 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.609901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:45.708572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.708517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:45.860421 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.860313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:45.935667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.935640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:45.939045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.939017    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-758fb67fc4-trpmj"]
Jul 06 19:06:45.943452 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.943434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:45.946280 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946248    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:06:45.946388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946311    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dpqtd\""
Jul 06 19:06:45.946388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946324    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:06:45.946508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ao77jftq5ccg\""
Jul 06 19:06:45.946508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946259    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:06:45.946508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:06:45.946812 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.946798    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:06:45.955781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:45.955686    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-758fb67fc4-trpmj"]
Jul 06 19:06:46.033950 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.033893    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-grpc-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xb9k\" (UniqueName: \"kubernetes.io/projected/c57baaf2-f843-47eb-a721-8b56af01fe54-kube-api-access-4xb9k\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57baaf2-f843-47eb-a721-8b56af01fe54-metrics-client-ca\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.073787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.073716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-grpc-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xb9k\" (UniqueName: \"kubernetes.io/projected/c57baaf2-f843-47eb-a721-8b56af01fe54-kube-api-access-4xb9k\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57baaf2-f843-47eb-a721-8b56af01fe54-metrics-client-ca\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.174736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.174582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.175651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.175623    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c57baaf2-f843-47eb-a721-8b56af01fe54-metrics-client-ca\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.185294 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.183968    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.185294 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.184453    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-grpc-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.185294 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.184826    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-tls\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.185294 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.185253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.186382 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.186323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.186882 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.186744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c57baaf2-f843-47eb-a721-8b56af01fe54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.190465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.190442    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xb9k\" (UniqueName: \"kubernetes.io/projected/c57baaf2-f843-47eb-a721-8b56af01fe54-kube-api-access-4xb9k\") pod \"thanos-querier-758fb67fc4-trpmj\" (UID: \"c57baaf2-f843-47eb-a721-8b56af01fe54\") " pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.246153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.246110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:46.266017 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.265972    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:46.410802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.410613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-758fb67fc4-trpmj"]
Jul 06 19:06:46.414978 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:46.414922    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57baaf2_f843_47eb_a721_8b56af01fe54.slice/crio-91a54254b28ac64e08009d249921aff121def62693dca83417751345afe26943 WatchSource:0}: Error finding container 91a54254b28ac64e08009d249921aff121def62693dca83417751345afe26943: Status 404 returned error can't find the container with id 91a54254b28ac64e08009d249921aff121def62693dca83417751345afe26943
Jul 06 19:06:46.602050 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.602011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slqsq" event={"ID":"b0e347ee-189d-4298-bf8e-1ae63ee37e64","Type":"ContainerStarted","Data":"48773c71e18f46ed184ea8a887321f59350a5190b35d9285bd026705d74910a6"}
Jul 06 19:06:46.602478 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.602072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slqsq" event={"ID":"b0e347ee-189d-4298-bf8e-1ae63ee37e64","Type":"ContainerStarted","Data":"49099e0b5e1ca1f41d02a85a3b649ddfb313faddf12363f3a59c9336f8510264"}
Jul 06 19:06:46.604342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.604215    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl" event={"ID":"28721649-2582-4cd5-96d7-c7ee50f830be","Type":"ContainerStarted","Data":"18cd9d3cd3d1b47d07acc8570476aa35d09e28c6340ce16a80960324711c97f7"}
Jul 06 19:06:46.604342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.604276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl" event={"ID":"28721649-2582-4cd5-96d7-c7ee50f830be","Type":"ContainerStarted","Data":"540680031f3d72e6565f688e16dad56f9b0513347b2917701a8eb8a82248afda"}
Jul 06 19:06:46.604342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.604306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl" event={"ID":"28721649-2582-4cd5-96d7-c7ee50f830be","Type":"ContainerStarted","Data":"a38de3cad7d74f2397892e90dbc08411c520c83d3d66a83d4f9b964207420e1c"}
Jul 06 19:06:46.605546 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.605524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"91a54254b28ac64e08009d249921aff121def62693dca83417751345afe26943"}
Jul 06 19:06:46.607663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.607642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd" event={"ID":"2d015adb-b261-4cdf-a0b7-750890dd1098","Type":"ContainerStarted","Data":"2b79544986bdccbdabb3a56c26e1baaf1ff10f46f4feff83b3db3ff520b738de"}
Jul 06 19:06:46.620943 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.620886    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-slqsq" podStartSLOduration=3.229439311 podStartE2EDuration="4.620870442s" totalImagesPullingTime="1.323140191s" totalInitContainerRuntime="68.29094ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:46.619374481 +0000 UTC m=+79.051632328" watchObservedRunningTime="2026-07-06 19:06:46.620870442 +0000 UTC m=+79.053128243"
Jul 06 19:06:46.637130 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.637067    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5qqpd" podStartSLOduration=3.317100128 podStartE2EDuration="4.637049892s" totalImagesPullingTime="1.319949764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:46.63556834 +0000 UTC m=+79.067826185" watchObservedRunningTime="2026-07-06 19:06:46.637049892 +0000 UTC m=+79.069307715"
Jul 06 19:06:46.656199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:46.656147    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mdsjl" podStartSLOduration=2.784446507 podStartE2EDuration="4.656128193s" totalImagesPullingTime="1.871681686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:46.655649429 +0000 UTC m=+79.087907254" watchObservedRunningTime="2026-07-06 19:06:46.656128193 +0000 UTC m=+79.088386018"
Jul 06 19:06:47.355285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.355200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"]
Jul 06 19:06:47.359671 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.359638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.362632 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.362605    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 19:06:47.364285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.363790    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7ike1m84sgaqn\""
Jul 06 19:06:47.364285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.363911    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 19:06:47.364285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.364088    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zdx52\""
Jul 06 19:06:47.364285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.364141    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:06:47.364285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.363791    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 19:06:47.369352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.368076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"]
Jul 06 19:06:47.487107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rg4d\" (UniqueName: \"kubernetes.io/projected/33c811c7-7231-4eba-96cd-6f9f62cf0da5-kube-api-access-7rg4d\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-client-certs\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33c811c7-7231-4eba-96cd-6f9f62cf0da5-audit-log\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-tls\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-client-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.487409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.487346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-metrics-server-audit-profiles\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.588809 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.588773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-client-certs\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.588819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33c811c7-7231-4eba-96cd-6f9f62cf0da5-audit-log\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.588847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-tls\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.588967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-client-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.589006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.589044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-metrics-server-audit-profiles\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.589128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rg4d\" (UniqueName: \"kubernetes.io/projected/33c811c7-7231-4eba-96cd-6f9f62cf0da5-kube-api-access-7rg4d\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.589271    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33c811c7-7231-4eba-96cd-6f9f62cf0da5-audit-log\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.589846 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.589817    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.590212 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.590188    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33c811c7-7231-4eba-96cd-6f9f62cf0da5-metrics-server-audit-profiles\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.591764 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.591737    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-client-certs\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.591956 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.591919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-client-ca-bundle\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.592056 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.592029    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33c811c7-7231-4eba-96cd-6f9f62cf0da5-secret-metrics-server-tls\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.597491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.597471    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rg4d\" (UniqueName: \"kubernetes.io/projected/33c811c7-7231-4eba-96cd-6f9f62cf0da5-kube-api-access-7rg4d\") pod \"metrics-server-5df74ffdf4-sdzdr\" (UID: \"33c811c7-7231-4eba-96cd-6f9f62cf0da5\") " pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.613862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.613834    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657" exitCode=0
Jul 06 19:06:47.614279 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.613954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"}
Jul 06 19:06:47.673035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.672995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:06:47.717220 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.717185    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"]
Jul 06 19:06:47.717220 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.717211    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:47.720899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.720877    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:47.723762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.723662    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:06:47.723890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.723787    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7bg5n\""
Jul 06 19:06:47.733357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.732029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"]
Jul 06 19:06:47.797596 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.791967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjhgj\" (UniqueName: \"kubernetes.io/projected/3ed2e506-da08-4cae-98fc-e07d746b1713-kube-api-access-pjhgj\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:47.797596 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.792020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:47.819901 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.819872    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"]
Jul 06 19:06:47.822575 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:47.822547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c811c7_7231_4eba_96cd_6f9f62cf0da5.slice/crio-03b01b5511a5e9eb3249be3b1f716f8ffdb5519f3f772d03a9df789964ce495b WatchSource:0}: Error finding container 03b01b5511a5e9eb3249be3b1f716f8ffdb5519f3f772d03a9df789964ce495b: Status 404 returned error can't find the container with id 03b01b5511a5e9eb3249be3b1f716f8ffdb5519f3f772d03a9df789964ce495b
Jul 06 19:06:47.893207 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.893117    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:47.893367 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:47.893230    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 19:06:47.893367 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.893269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjhgj\" (UniqueName: \"kubernetes.io/projected/3ed2e506-da08-4cae-98fc-e07d746b1713-kube-api-access-pjhgj\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:47.893367 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:06:47.893305    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert podName:3ed2e506-da08-4cae-98fc-e07d746b1713 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:48.393286545 +0000 UTC m=+80.825544347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-f9bw9" (UID: "3ed2e506-da08-4cae-98fc-e07d746b1713") : secret "monitoring-plugin-cert" not found
Jul 06 19:06:47.902033 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:47.901997    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjhgj\" (UniqueName: \"kubernetes.io/projected/3ed2e506-da08-4cae-98fc-e07d746b1713-kube-api-access-pjhgj\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:48.083557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:48.083519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:48.397376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:48.397346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:48.399639 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:48.399621    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ed2e506-da08-4cae-98fc-e07d746b1713-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9bw9\" (UID: \"3ed2e506-da08-4cae-98fc-e07d746b1713\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:48.620181 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:48.620144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr" event={"ID":"33c811c7-7231-4eba-96cd-6f9f62cf0da5","Type":"ContainerStarted","Data":"03b01b5511a5e9eb3249be3b1f716f8ffdb5519f3f772d03a9df789964ce495b"}
Jul 06 19:06:48.642453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:48.642394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:49.228144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.228036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:49.228510 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.228487    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:06:49.232646 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.232628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.235761 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.235738    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hhjpf\""
Jul 06 19:06:49.235860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.235788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 19:06:49.235996 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.235975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 19:06:49.237765 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.237740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 19:06:49.238049 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 19:06:49.238285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238268    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 19:06:49.238482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238465    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 19:06:49.238605 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238588    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 19:06:49.238781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238467    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 19:06:49.239075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.239059    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 19:06:49.239289 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.239275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 19:06:49.239485 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.238512    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 19:06:49.239835 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.239820    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 19:06:49.239962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.239947    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e7f4ld9kqfeoa\""
Jul 06 19:06:49.240100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.239886    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 19:06:49.243212 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.243180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 19:06:49.253365 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.252014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.308683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qt76\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.308826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.309525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.309088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.313531 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.313504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:49.384679 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.384644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.409979    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.410217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.411465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410289    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.411465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410668    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.413914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.410121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.413914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.411984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.413914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.412016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qt76\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.413914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.412052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.413914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.412094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.414705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.414676    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.414947 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.414907    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.417475    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.419108    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.420222    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.420575    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.422427    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.423007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.423417    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.424101    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.424813    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.425465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.424630    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.429997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.426083    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.429997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.426598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.429997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.428324    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.431522 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.431299    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.432339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.432316    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.435458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.435411    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qt76\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76\") pod \"prometheus-k8s-0\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.552593 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.552493    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:49.582913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.582864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:49.746946 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.746899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:49.927515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:49.927471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:50.030417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.030377    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:50.332442 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.332254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:50.368127 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.368100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:06:50.370431 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:50.370407    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3f7344_325f_46ff_bfd1_ad7213e25b43.slice/crio-36db34fb6bb5d407ee270ead192eb89d488f4eaf84661a950ef99b7eb8bbb843 WatchSource:0}: Error finding container 36db34fb6bb5d407ee270ead192eb89d488f4eaf84661a950ef99b7eb8bbb843: Status 404 returned error can't find the container with id 36db34fb6bb5d407ee270ead192eb89d488f4eaf84661a950ef99b7eb8bbb843
Jul 06 19:06:50.380817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.380747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"]
Jul 06 19:06:50.392167 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:06:50.392127    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed2e506_da08_4cae_98fc_e07d746b1713.slice/crio-60d2f3e374b6d3dca4b32a59941b591b74b10a4bc421b6cf7833d28d6e61c761 WatchSource:0}: Error finding container 60d2f3e374b6d3dca4b32a59941b591b74b10a4bc421b6cf7833d28d6e61c761: Status 404 returned error can't find the container with id 60d2f3e374b6d3dca4b32a59941b591b74b10a4bc421b6cf7833d28d6e61c761
Jul 06 19:06:50.635767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.635737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"9ca632f97c771601bd7366a8b0217e26668ae924cc46fcc88d9ea728869e6e41"}
Jul 06 19:06:50.635863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.635822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"3bdd261bcfd2909f4e6ce51b01f6d907f83bfa57ed34076a53f3f097d3a3901b"}
Jul 06 19:06:50.635916 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.635866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"54c907b067954df106aa8b701a93cbb7b395a65efc3d0a47f41057498f4ffbf1"}
Jul 06 19:06:50.637555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.637516    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e" exitCode=0
Jul 06 19:06:50.637672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.637613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e"}
Jul 06 19:06:50.637744 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.637688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"36db34fb6bb5d407ee270ead192eb89d488f4eaf84661a950ef99b7eb8bbb843"}
Jul 06 19:06:50.639487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.639463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr" event={"ID":"33c811c7-7231-4eba-96cd-6f9f62cf0da5","Type":"ContainerStarted","Data":"f2a0a74079a59532412a68a8602e5fdb354951aecba7b7dfe3086fbce9995fe8"}
Jul 06 19:06:50.640735 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.640712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9" event={"ID":"3ed2e506-da08-4cae-98fc-e07d746b1713","Type":"ContainerStarted","Data":"60d2f3e374b6d3dca4b32a59941b591b74b10a4bc421b6cf7833d28d6e61c761"}
Jul 06 19:06:50.643877 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.643854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"}
Jul 06 19:06:50.643972 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.643920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"}
Jul 06 19:06:50.644011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.643987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"}
Jul 06 19:06:50.644058 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.644026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"}
Jul 06 19:06:50.684192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:50.684142    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr" podStartSLOduration=1.241414368 podStartE2EDuration="3.684125724s" totalImagesPullingTime="2.442711356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:50.683137379 +0000 UTC m=+83.115395204" watchObservedRunningTime="2026-07-06 19:06:50.684125724 +0000 UTC m=+83.116383598"
Jul 06 19:06:51.112415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.112376    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:51.213684 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.213631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:51.355524 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.355491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:51.518991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.518952    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:51.655581 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.655410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"}
Jul 06 19:06:51.655581 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.655524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerStarted","Data":"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"}
Jul 06 19:06:51.661353 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.661278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"7fdbbdb9c88fc5f249397e65ae7ca70cfdbcb86aec165a06c94fe535259c862f"}
Jul 06 19:06:51.681651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.681461    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.539496669 podStartE2EDuration="7.681438651s" totalImagesPullingTime="5.126742367s" totalInitContainerRuntime="15.199615ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:51.680969575 +0000 UTC m=+84.113227400" watchObservedRunningTime="2026-07-06 19:06:51.681438651 +0000 UTC m=+84.113696476"
Jul 06 19:06:51.802426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.802381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:51.859406 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:51.859374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:52.667995 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.667959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9" event={"ID":"3ed2e506-da08-4cae-98fc-e07d746b1713","Type":"ContainerStarted","Data":"a33d7d2390f71a79a1af7ebf1c0389bdccaccd88a5d8755afe0402303922f19d"}
Jul 06 19:06:52.668430 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.668020    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:52.671464 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.671431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"a1ed09f406adb07538ba1c1197824040a8856030f859e088b4aebbd64a4cbcc6"}
Jul 06 19:06:52.671606 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.671528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" event={"ID":"c57baaf2-f843-47eb-a721-8b56af01fe54","Type":"ContainerStarted","Data":"d8db3444a45663be287066d7eaa6a617581a265d5e2805257e027140f1b2f880"}
Jul 06 19:06:52.671606 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.671582    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:52.674110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.674085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9"
Jul 06 19:06:52.685369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.685296    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9bw9" podStartSLOduration=3.934110339 podStartE2EDuration="5.685275124s" totalImagesPullingTime="1.751164785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:52.682546148 +0000 UTC m=+85.114803973" watchObservedRunningTime="2026-07-06 19:06:52.685275124 +0000 UTC m=+85.117532971"
Jul 06 19:06:52.703285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:52.703230    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj" podStartSLOduration=2.920928419 podStartE2EDuration="7.703214706s" totalImagesPullingTime="4.782286287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:52.702222603 +0000 UTC m=+85.134480447" watchObservedRunningTime="2026-07-06 19:06:52.703214706 +0000 UTC m=+85.135472563"
Jul 06 19:06:54.688067 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:54.688025    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"}
Jul 06 19:06:54.688385 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:54.688119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"}
Jul 06 19:06:54.875419 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:54.875365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:54.975029 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:54.974993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:55.694779 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.694747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"}
Jul 06 19:06:55.695153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.694811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"}
Jul 06 19:06:55.695153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.694838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"}
Jul 06 19:06:55.695153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.694862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerStarted","Data":"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"}
Jul 06 19:06:55.725692 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.725641    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.831951502 podStartE2EDuration="6.725623976s" totalImagesPullingTime="3.867859058s" totalInitContainerRuntime="25.813416ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:55.722949444 +0000 UTC m=+88.155207273" watchObservedRunningTime="2026-07-06 19:06:55.725623976 +0000 UTC m=+88.157881779"
Jul 06 19:06:55.999441 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:55.999367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:56.057622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:56.057581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:57.376531 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:57.376489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:57.433060 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:57.433026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:58.691645 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:58.691622    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-758fb67fc4-trpmj"
Jul 06 19:06:59.552993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:59.552960    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:06:59.567146 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:59.567115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:59.615819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:06:59.615786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:02.727776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:02.727745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:02.829495 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:02.829466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:02.885214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:02.885179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:03.604408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:03.604379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:03.652179 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:03.652146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:07.372209 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:07.372169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:07.433619 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:07.433581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:07.673784 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:07.673701    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:07:07.673784 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:07.673764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:07:10.569808 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:10.569775    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbkr6"
Jul 06 19:07:11.005734 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:11.005702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:11.066313 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:11.066281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:13.182464 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:13.182429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:13.235227 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:13.235194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:16.573384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:16.573341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:19.147135 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:19.147089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:19.244796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:19.244760    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:19.292559 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:19.292526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:19.860695 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:19.860658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:19.939801 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:19.939771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:27.635193 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:27.635155    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:27.678751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:27.678723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:07:27.682491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:27.682466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5df74ffdf4-sdzdr"
Jul 06 19:07:27.684482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:27.684456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:31.191286 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:31.191246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:32.721325 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:32.721287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:32.821524 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:32.821486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:41.003184 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:41.003149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:41.055217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:41.055187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:49.552906 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:49.552858    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:07:49.571867 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:49.571840    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:07:49.936989 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:49.936965    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:07:59.015475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:59.015441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:07:59.070812 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:07:59.070775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:03.254168 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254132    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:08:03.254582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254482    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="alertmanager" containerID="cri-o://f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375" gracePeriod=120
Jul 06 19:08:03.254582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254554    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-web" containerID="cri-o://3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009" gracePeriod=120
Jul 06 19:08:03.254582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254553    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-metric" containerID="cri-o://c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798" gracePeriod=120
Jul 06 19:08:03.254801 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254591    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy" containerID="cri-o://ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e" gracePeriod=120
Jul 06 19:08:03.254801 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254610    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="config-reloader" containerID="cri-o://94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012" gracePeriod=120
Jul 06 19:08:03.254801 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.254697    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="prom-label-proxy" containerID="cri-o://52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97" gracePeriod=120
Jul 06 19:08:03.981622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981587    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97" exitCode=0
Jul 06 19:08:03.981622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981617    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e" exitCode=0
Jul 06 19:08:03.981622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981623    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012" exitCode=0
Jul 06 19:08:03.981622 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981631    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375" exitCode=0
Jul 06 19:08:03.981904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"}
Jul 06 19:08:03.981904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"}
Jul 06 19:08:03.981904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"}
Jul 06 19:08:03.981904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:03.981782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"}
Jul 06 19:08:04.541861 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.541831    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:08:04.561665 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561665 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561778    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbdlv\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.561873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561905    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.561981    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562000    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562040    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562099    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca\") pod \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\" (UID: \"e471abb6-8f72-4e82-abc8-ccc8ddcda59a\") "
Jul 06 19:08:04.562503 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562365    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-main-db\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.562503 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562434    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:04.562721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.562681    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:04.565284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.565206    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume" (OuterVolumeSpecName: "config-volume") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.565384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.565307    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.565546 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.565504    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.565718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.565585    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.566175 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.566079    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv" (OuterVolumeSpecName: "kube-api-access-tbdlv") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "kube-api-access-tbdlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:08:04.566301 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.566275    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.567030 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.566869    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out" (OuterVolumeSpecName: "config-out") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:08:04.567839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.567796    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:08:04.572534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.572497    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.579882 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.579855    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config" (OuterVolumeSpecName: "web-config") pod "e471abb6-8f72-4e82-abc8-ccc8ddcda59a" (UID: "e471abb6-8f72-4e82-abc8-ccc8ddcda59a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:04.663235 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663194    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-web-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663235 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663233    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-main-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663252    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-cluster-tls-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663266    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663282    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbdlv\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-kube-api-access-tbdlv\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663295    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-out\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663310    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663323    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-tls-assets\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663336    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-config-volume\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663349    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663363    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.663432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.663375    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e471abb6-8f72-4e82-abc8-ccc8ddcda59a-metrics-client-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:04.725502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.725456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:04.988894 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.988858    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798" exitCode=0
Jul 06 19:08:04.988894 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.988884    2559 generic.go:356] "Generic (PLEG): container finished" podID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerID="3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009" exitCode=0
Jul 06 19:08:04.989122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.988959    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:08:04.989122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.988959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"}
Jul 06 19:08:04.989122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.989041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"}
Jul 06 19:08:04.989122 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.989084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e471abb6-8f72-4e82-abc8-ccc8ddcda59a","Type":"ContainerDied","Data":"e2c8b61eaf3cee8d2e6f00ae6799ee4dc3028678943e35e2be5af1a9b9813631"}
Jul 06 19:08:04.990103 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.989125    2559 scope.go:117] "RemoveContainer" containerID="52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"
Jul 06 19:08:04.997910 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:04.997895    2559 scope.go:117] "RemoveContainer" containerID="c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"
Jul 06 19:08:05.004506 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.004491    2559 scope.go:117] "RemoveContainer" containerID="ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"
Jul 06 19:08:05.011878 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.011857    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:08:05.012834 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.012811    2559 scope.go:117] "RemoveContainer" containerID="3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"
Jul 06 19:08:05.014283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.014265    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:08:05.019556 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.019529    2559 scope.go:117] "RemoveContainer" containerID="94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"
Jul 06 19:08:05.026336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.026309    2559 scope.go:117] "RemoveContainer" containerID="f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"
Jul 06 19:08:05.033438 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.033421    2559 scope.go:117] "RemoveContainer" containerID="87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"
Jul 06 19:08:05.041603 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.041586    2559 scope.go:117] "RemoveContainer" containerID="52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"
Jul 06 19:08:05.041906 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.041887    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97\": container with ID starting with 52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97 not found: ID does not exist" containerID="52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"
Jul 06 19:08:05.041979 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.041915    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"} err="failed to get container status \"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97\": rpc error: code = NotFound desc = could not find container \"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97\": container with ID starting with 52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97 not found: ID does not exist"
Jul 06 19:08:05.041979 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.041967    2559 scope.go:117] "RemoveContainer" containerID="c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"
Jul 06 19:08:05.042244 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.042225    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798\": container with ID starting with c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798 not found: ID does not exist" containerID="c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"
Jul 06 19:08:05.042289 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042249    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"} err="failed to get container status \"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798\": rpc error: code = NotFound desc = could not find container \"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798\": container with ID starting with c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798 not found: ID does not exist"
Jul 06 19:08:05.042289 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042266    2559 scope.go:117] "RemoveContainer" containerID="ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"
Jul 06 19:08:05.042481 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.042465    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e\": container with ID starting with ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e not found: ID does not exist" containerID="ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"
Jul 06 19:08:05.042541 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042490    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"} err="failed to get container status \"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e\": rpc error: code = NotFound desc = could not find container \"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e\": container with ID starting with ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e not found: ID does not exist"
Jul 06 19:08:05.042541 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042511    2559 scope.go:117] "RemoveContainer" containerID="3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"
Jul 06 19:08:05.042751 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.042737    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009\": container with ID starting with 3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009 not found: ID does not exist" containerID="3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"
Jul 06 19:08:05.042791 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042756    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"} err="failed to get container status \"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009\": rpc error: code = NotFound desc = could not find container \"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009\": container with ID starting with 3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009 not found: ID does not exist"
Jul 06 19:08:05.042791 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042774    2559 scope.go:117] "RemoveContainer" containerID="94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"
Jul 06 19:08:05.042977 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.042961    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012\": container with ID starting with 94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012 not found: ID does not exist" containerID="94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"
Jul 06 19:08:05.043015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042983    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"} err="failed to get container status \"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012\": rpc error: code = NotFound desc = could not find container \"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012\": container with ID starting with 94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012 not found: ID does not exist"
Jul 06 19:08:05.043015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.042997    2559 scope.go:117] "RemoveContainer" containerID="f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"
Jul 06 19:08:05.043212 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.043196    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375\": container with ID starting with f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375 not found: ID does not exist" containerID="f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"
Jul 06 19:08:05.043274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043218    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"} err="failed to get container status \"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375\": rpc error: code = NotFound desc = could not find container \"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375\": container with ID starting with f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375 not found: ID does not exist"
Jul 06 19:08:05.043274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043237    2559 scope.go:117] "RemoveContainer" containerID="87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"
Jul 06 19:08:05.043448 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:05.043434    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657\": container with ID starting with 87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657 not found: ID does not exist" containerID="87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"
Jul 06 19:08:05.043485 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043452    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"} err="failed to get container status \"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657\": rpc error: code = NotFound desc = could not find container \"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657\": container with ID starting with 87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657 not found: ID does not exist"
Jul 06 19:08:05.043485 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043465    2559 scope.go:117] "RemoveContainer" containerID="52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"
Jul 06 19:08:05.043670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043625    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97"} err="failed to get container status \"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97\": rpc error: code = NotFound desc = could not find container \"52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97\": container with ID starting with 52e08c44107d0e5bd4c4641b635f74f5f6da39ee70d0ccba3838f1b0b83b7c97 not found: ID does not exist"
Jul 06 19:08:05.043670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043639    2559 scope.go:117] "RemoveContainer" containerID="c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"
Jul 06 19:08:05.043824 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043809    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798"} err="failed to get container status \"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798\": rpc error: code = NotFound desc = could not find container \"c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798\": container with ID starting with c3a257908706c0ac799491db3e93fe842414cef62492fc9f58940f09bd4a7798 not found: ID does not exist"
Jul 06 19:08:05.043863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.043825    2559 scope.go:117] "RemoveContainer" containerID="ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"
Jul 06 19:08:05.044116 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044096    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e"} err="failed to get container status \"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e\": rpc error: code = NotFound desc = could not find container \"ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e\": container with ID starting with ec373bf27adcb61bf47544c40d7ac1880b91b6f35baeed37eb8d919e3487e84e not found: ID does not exist"
Jul 06 19:08:05.044116 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044115    2559 scope.go:117] "RemoveContainer" containerID="3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"
Jul 06 19:08:05.044339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044322    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009"} err="failed to get container status \"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009\": rpc error: code = NotFound desc = could not find container \"3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009\": container with ID starting with 3ac8bfe9774a5adccf30cebfcacffdc23c5dd8c8c14a12916e372717763c5009 not found: ID does not exist"
Jul 06 19:08:05.044386 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044341    2559 scope.go:117] "RemoveContainer" containerID="94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"
Jul 06 19:08:05.044580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044561    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012"} err="failed to get container status \"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012\": rpc error: code = NotFound desc = could not find container \"94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012\": container with ID starting with 94970c595a759bd764cb5bf3b5353c15910834c267bf72aa61e11be7c33c0012 not found: ID does not exist"
Jul 06 19:08:05.044627 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044582    2559 scope.go:117] "RemoveContainer" containerID="f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"
Jul 06 19:08:05.044789 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044772    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375"} err="failed to get container status \"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375\": rpc error: code = NotFound desc = could not find container \"f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375\": container with ID starting with f37ed324c42179bc3857a35121d5419944026737f60315fec8487c0037f7e375 not found: ID does not exist"
Jul 06 19:08:05.044824 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.044790    2559 scope.go:117] "RemoveContainer" containerID="87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"
Jul 06 19:08:05.045035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:05.045015    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657"} err="failed to get container status \"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657\": rpc error: code = NotFound desc = could not find container \"87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657\": container with ID starting with 87512e76508adc2e118e5417b9411c90d9e2fe8329c9e031ee4e088b777a1657 not found: ID does not exist"
Jul 06 19:08:06.140517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:06.140488    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" path="/var/lib/kubelet/pods/e471abb6-8f72-4e82-abc8-ccc8ddcda59a/volumes"
Jul 06 19:08:07.483908 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.483876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484170    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="prometheus" containerID="cri-o://55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851" gracePeriod=600
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484202    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy" containerID="cri-o://b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3" gracePeriod=600
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484222    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="config-reloader" containerID="cri-o://875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e" gracePeriod=600
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484271    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818" gracePeriod=600
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484269    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-web" containerID="cri-o://bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8" gracePeriod=600
Jul 06 19:08:07.484343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:07.484204    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="thanos-sidecar" containerID="cri-o://9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3" gracePeriod=600
Jul 06 19:08:08.007274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007242    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818" exitCode=0
Jul 06 19:08:08.007274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007268    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3" exitCode=0
Jul 06 19:08:08.007274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007277    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3" exitCode=0
Jul 06 19:08:08.007274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007282    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e" exitCode=0
Jul 06 19:08:08.007274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007288    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851" exitCode=0
Jul 06 19:08:08.007564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"}
Jul 06 19:08:08.007564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"}
Jul 06 19:08:08.007564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"}
Jul 06 19:08:08.007564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"}
Jul 06 19:08:08.007564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.007440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"}
Jul 06 19:08:08.725344 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.725320    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:08.801437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801432    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801453    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801494    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801515    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801647    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qt76\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.801691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801763    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801789    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801888    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.802019    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.802160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.802047    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file\") pod \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\" (UID: \"6b3f7344-325f-46ff-bfd1-ad7213e25b43\") "
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.801810    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.802487    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.802622    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.803152    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.802661    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.803123    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.803274    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.804862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.804786    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:08:08.805760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.805731    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.806952 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.806900    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.807100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807072    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.807177 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807151    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.807319 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807284    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out" (OuterVolumeSpecName: "config-out") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:08:08.807426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807335    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.807426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807380    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.807901 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807871    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76" (OuterVolumeSpecName: "kube-api-access-9qt76") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "kube-api-access-9qt76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:08:08.807994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.807910    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config" (OuterVolumeSpecName: "config") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.808392 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.808373    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:08:08.808837 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.808818    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.816158 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.816138    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config" (OuterVolumeSpecName: "web-config") pod "6b3f7344-325f-46ff-bfd1-ad7213e25b43" (UID: "6b3f7344-325f-46ff-bfd1-ad7213e25b43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:08:08.903388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903345    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903382    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-metrics-client-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903393    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qt76\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-kube-api-access-9qt76\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903402    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-web-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903412    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b3f7344-325f-46ff-bfd1-ad7213e25b43-tls-assets\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903420    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903429    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903438    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903447    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903456    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903464    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903472    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903480    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-db\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903488    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-kube-rbac-proxy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903496    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903504    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-grpc-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903511    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b3f7344-325f-46ff-bfd1-ad7213e25b43-config-out\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903519    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-metrics-client-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903528    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b3f7344-325f-46ff-bfd1-ad7213e25b43-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:08.903643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:08.903536    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f7344-325f-46ff-bfd1-ad7213e25b43-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:08:09.014798 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.014761    2559 generic.go:356] "Generic (PLEG): container finished" podID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerID="bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8" exitCode=0
Jul 06 19:08:09.014941 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.014855    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.015001 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.014849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"}
Jul 06 19:08:09.015032 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.014998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b3f7344-325f-46ff-bfd1-ad7213e25b43","Type":"ContainerDied","Data":"36db34fb6bb5d407ee270ead192eb89d488f4eaf84661a950ef99b7eb8bbb843"}
Jul 06 19:08:09.015066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.015030    2559 scope.go:117] "RemoveContainer" containerID="9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"
Jul 06 19:08:09.027614 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.027595    2559 scope.go:117] "RemoveContainer" containerID="b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"
Jul 06 19:08:09.034502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.034482    2559 scope.go:117] "RemoveContainer" containerID="bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"
Jul 06 19:08:09.041592 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.041573    2559 scope.go:117] "RemoveContainer" containerID="9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"
Jul 06 19:08:09.043297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.043275    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:09.047351 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.047333    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:09.048765 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.048748    2559 scope.go:117] "RemoveContainer" containerID="875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"
Jul 06 19:08:09.055119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.055103    2559 scope.go:117] "RemoveContainer" containerID="55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"
Jul 06 19:08:09.061769 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.061742    2559 scope.go:117] "RemoveContainer" containerID="11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e"
Jul 06 19:08:09.068001 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.067986    2559 scope.go:117] "RemoveContainer" containerID="9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"
Jul 06 19:08:09.068292 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.068247    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818\": container with ID starting with 9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818 not found: ID does not exist" containerID="9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"
Jul 06 19:08:09.068292 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.068274    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818"} err="failed to get container status \"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818\": rpc error: code = NotFound desc = could not find container \"9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818\": container with ID starting with 9f6d9949dc54e3c66e01532349db1f450d18a728f008bb541e47b8a413913818 not found: ID does not exist"
Jul 06 19:08:09.068292 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.068294    2559 scope.go:117] "RemoveContainer" containerID="b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"
Jul 06 19:08:09.068651 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.068621    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3\": container with ID starting with b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3 not found: ID does not exist" containerID="b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"
Jul 06 19:08:09.068756 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.068657    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3"} err="failed to get container status \"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3\": rpc error: code = NotFound desc = could not find container \"b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3\": container with ID starting with b077daebe99342722dd6e06546e01d0adf07b2aa4f55d97dccaa1798a92426b3 not found: ID does not exist"
Jul 06 19:08:09.068756 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.068680    2559 scope.go:117] "RemoveContainer" containerID="bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"
Jul 06 19:08:09.069040 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.069021    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8\": container with ID starting with bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8 not found: ID does not exist" containerID="bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"
Jul 06 19:08:09.069131 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069048    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8"} err="failed to get container status \"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8\": rpc error: code = NotFound desc = could not find container \"bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8\": container with ID starting with bc988d7a1cc8edb58df0c11cd7a174fc2ea17b61b136961fc09dc69c1cef89f8 not found: ID does not exist"
Jul 06 19:08:09.069131 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069069    2559 scope.go:117] "RemoveContainer" containerID="9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"
Jul 06 19:08:09.069345 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.069320    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3\": container with ID starting with 9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3 not found: ID does not exist" containerID="9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"
Jul 06 19:08:09.069437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069350    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3"} err="failed to get container status \"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3\": rpc error: code = NotFound desc = could not find container \"9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3\": container with ID starting with 9caa44a2985c884ac09e34b068ae44d5480fef2a475b019cd151b82be2e97cd3 not found: ID does not exist"
Jul 06 19:08:09.069437 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069365    2559 scope.go:117] "RemoveContainer" containerID="875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"
Jul 06 19:08:09.069879 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.069860    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e\": container with ID starting with 875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e not found: ID does not exist" containerID="875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"
Jul 06 19:08:09.069974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069880    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e"} err="failed to get container status \"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e\": rpc error: code = NotFound desc = could not find container \"875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e\": container with ID starting with 875a0a6956fef83ae6a1238a6c1428e7405d61ccaa51f81e24cb08cb233dd78e not found: ID does not exist"
Jul 06 19:08:09.069974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.069895    2559 scope.go:117] "RemoveContainer" containerID="55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"
Jul 06 19:08:09.070139 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.070122    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851\": container with ID starting with 55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851 not found: ID does not exist" containerID="55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"
Jul 06 19:08:09.070216 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070142    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851"} err="failed to get container status \"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851\": rpc error: code = NotFound desc = could not find container \"55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851\": container with ID starting with 55d885ca92ef99f956a68a0c80fc2f2b1da847fc6de44794ee7fdb5a6d740851 not found: ID does not exist"
Jul 06 19:08:09.070216 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070155    2559 scope.go:117] "RemoveContainer" containerID="11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e"
Jul 06 19:08:09.070344 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070327    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:09.070443 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:08:09.070411    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e\": container with ID starting with 11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e not found: ID does not exist" containerID="11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e"
Jul 06 19:08:09.070534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070447    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e"} err="failed to get container status \"11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e\": rpc error: code = NotFound desc = could not find container \"11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e\": container with ID starting with 11e152d0f628706440fd2aa3538ee45504c059b4555ceafb6ac7998bcd4e126e not found: ID does not exist"
Jul 06 19:08:09.070698 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070681    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="alertmanager"
Jul 06 19:08:09.070760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="alertmanager"
Jul 06 19:08:09.070760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="prom-label-proxy"
Jul 06 19:08:09.070760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070733    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="prom-label-proxy"
Jul 06 19:08:09.070760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070744    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.070760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070752    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070763    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070771    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070787    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070796    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070806    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="init-config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070814    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="init-config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070823    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="init-config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070832    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="init-config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070844    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="thanos-sidecar"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070852    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="thanos-sidecar"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070864    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-thanos"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070872    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-thanos"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070882    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-metric"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070891    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-metric"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070902    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="prometheus"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070909    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="prometheus"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070918    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070941    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070952    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070960    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070974    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="config-reloader"
Jul 06 19:08:09.071020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.070982    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="config-reloader"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071061    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="alertmanager"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071074    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="prom-label-proxy"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071083    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071092    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="config-reloader"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071103    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="config-reloader"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071111    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-metric"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071118    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="prometheus"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071127    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071137    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e471abb6-8f72-4e82-abc8-ccc8ddcda59a" containerName="kube-rbac-proxy"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071145    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="thanos-sidecar"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071154    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-web"
Jul 06 19:08:09.072011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.071161    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" containerName="kube-rbac-proxy-thanos"
Jul 06 19:08:09.076311 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.076293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.079116 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.079089    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 19:08:09.080196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080177    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080407    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080422    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080433    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080422    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080461    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hhjpf\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080436    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 19:08:09.080597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.080559    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 19:08:09.081650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.081439    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 19:08:09.081650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.081441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e7f4ld9kqfeoa\""
Jul 06 19:08:09.081650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.081521    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 19:08:09.081650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.081560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 19:08:09.084034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.084013    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 19:08:09.085287 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.085266    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 19:08:09.090372 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.090351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:09.105015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.104992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105091 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105091 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105091 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105314 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105314 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-848kj\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-kube-api-access-848kj\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105501    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.105638 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.105533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.206802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.206765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.206802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.206803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.206950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207624 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.207624 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207570    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207757    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.207958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-848kj\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-kube-api-access-848kj\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208272    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.208564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.208444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.209216 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.209083    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.210490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.209983    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211141 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211039    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211141 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e553fb87-73c1-4d5f-9c02-80b280f51cf6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211467 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211383    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-web-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211467 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211411    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config-out\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211619 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211597    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211754 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211732    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.211790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.211751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.212263 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.212233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.212396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.212373    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-config\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.212601 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.212583    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.212675 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.212656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.213614 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.213597    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e553fb87-73c1-4d5f-9c02-80b280f51cf6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.218149 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.218134    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-848kj\" (UniqueName: \"kubernetes.io/projected/e553fb87-73c1-4d5f-9c02-80b280f51cf6-kube-api-access-848kj\") pod \"prometheus-k8s-0\" (UID: \"e553fb87-73c1-4d5f-9c02-80b280f51cf6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.386631 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.386596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:09.519170 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:09.519143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 19:08:09.520717 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:08:09.520695    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode553fb87_73c1_4d5f_9c02_80b280f51cf6.slice/crio-fd77c60b4b2ab48c37531ce1c33ccc518fd1a2dc3b1f1beaac0c29ab6d4cfe63 WatchSource:0}: Error finding container fd77c60b4b2ab48c37531ce1c33ccc518fd1a2dc3b1f1beaac0c29ab6d4cfe63: Status 404 returned error can't find the container with id fd77c60b4b2ab48c37531ce1c33ccc518fd1a2dc3b1f1beaac0c29ab6d4cfe63
Jul 06 19:08:10.019887 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.019851    2559 generic.go:356] "Generic (PLEG): container finished" podID="e553fb87-73c1-4d5f-9c02-80b280f51cf6" containerID="21d4ba2dcec737a943a756b9104d0ac79d7230561fabd6d665a51b4308002064" exitCode=0
Jul 06 19:08:10.020343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.019959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerDied","Data":"21d4ba2dcec737a943a756b9104d0ac79d7230561fabd6d665a51b4308002064"}
Jul 06 19:08:10.020343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.020028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"fd77c60b4b2ab48c37531ce1c33ccc518fd1a2dc3b1f1beaac0c29ab6d4cfe63"}
Jul 06 19:08:10.141617 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.141579    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3f7344-325f-46ff-bfd1-ad7213e25b43" path="/var/lib/kubelet/pods/6b3f7344-325f-46ff-bfd1-ad7213e25b43/volumes"
Jul 06 19:08:10.787528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.787496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:10.839475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:10.839441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:11.027941 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.027894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"9d284f75ea8c6bc8807605ca238d135f9e7b203f1ab33a0e75eabc6d03eb2871"}
Jul 06 19:08:11.028307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.027979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"442365741d585d9965da81bf0aa3e7b35b55194014746477b5fe26d27e54ebd7"}
Jul 06 19:08:11.028307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.028008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"07be0583c2e293c7d2e99082b035853aeeda024b1edd9482c77b8fd3e678148c"}
Jul 06 19:08:11.028307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.028032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"533afc08ea13fb37f77bc96c2510e56e1f4763976bf929bc194bf84149bf27c2"}
Jul 06 19:08:11.028307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.028055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"7867519dff0d2291cd5825fa9fb346bed2c3c95cd6130a10e449960978f6e4fb"}
Jul 06 19:08:11.028307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.028078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e553fb87-73c1-4d5f-9c02-80b280f51cf6","Type":"ContainerStarted","Data":"b8f593b1f0ca92baf71b5349663ad3d234c10f78f055e73db3a398880b8b6c26"}
Jul 06 19:08:11.059820 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.059719    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.039918683 podStartE2EDuration="2.059703081s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.784398ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:11.05789716 +0000 UTC m=+163.490154985" watchObservedRunningTime="2026-07-06 19:08:11.059703081 +0000 UTC m=+163.491960904"
Jul 06 19:08:11.164377 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.164339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:11.213458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:11.213422    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:14.387164 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:14.387124    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:08:22.363462 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:22.363374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:22.417764 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:22.417721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:26.005546 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:26.005508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:26.107042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:26.107012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:43.022520 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:43.022479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:08:43.105429 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:08:43.105390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:02.860260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:02.860224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:09.387761 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:09.387719    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:09:09.402952 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:09.402913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:09:09.621921 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:09.621886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:10.278181 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:10.278154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 19:09:10.466200 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:10.466167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:13.231958 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:13.231907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:13.289034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:13.288998    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:15.226731 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:15.226696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:15.319597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:15.319561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:15.835954 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:15.835907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:15.944746 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:15.944715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:17.431380 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:17.431349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:17.610149 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:17.610111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:20.036335 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:20.036303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:20.101384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:20.101353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:25.624942 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:25.624904    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:36.440527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:36.440480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:36.509039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:36.509006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:42.974660 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:42.974623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:43.070664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:43.070624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:44.699754 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.699719    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"]
Jul 06 19:09:44.702296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.702281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.705047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.705025    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-47zv7\""
Jul 06 19:09:44.705166 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.705080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:09:44.706413 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.706398    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:09:44.711207 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.711186    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"]
Jul 06 19:09:44.714384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.714358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl8d9\" (UniqueName: \"kubernetes.io/projected/c2aaa989-d930-4849-a6d1-4d4b921773ba-kube-api-access-kl8d9\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.714491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.714478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2aaa989-d930-4849-a6d1-4d4b921773ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.815048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.815017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl8d9\" (UniqueName: \"kubernetes.io/projected/c2aaa989-d930-4849-a6d1-4d4b921773ba-kube-api-access-kl8d9\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.815230 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.815080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2aaa989-d930-4849-a6d1-4d4b921773ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.815405 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.815388    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2aaa989-d930-4849-a6d1-4d4b921773ba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:44.824576 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:44.824554    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl8d9\" (UniqueName: \"kubernetes.io/projected/c2aaa989-d930-4849-a6d1-4d4b921773ba-kube-api-access-kl8d9\") pod \"openshift-lws-operator-fd8ccff4c-lzfzv\" (UID: \"c2aaa989-d930-4849-a6d1-4d4b921773ba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:45.011748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:45.011650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"
Jul 06 19:09:45.140026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:45.139999    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv"]
Jul 06 19:09:45.142736 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:09:45.142714    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2aaa989_d930_4849_a6d1_4d4b921773ba.slice/crio-fe34db26ca16fd84f5a8a7c92b9f33b27c2aebba802c64054831e72585878d6a WatchSource:0}: Error finding container fe34db26ca16fd84f5a8a7c92b9f33b27c2aebba802c64054831e72585878d6a: Status 404 returned error can't find the container with id fe34db26ca16fd84f5a8a7c92b9f33b27c2aebba802c64054831e72585878d6a
Jul 06 19:09:45.402176 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:45.402147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv" event={"ID":"c2aaa989-d930-4849-a6d1-4d4b921773ba","Type":"ContainerStarted","Data":"fe34db26ca16fd84f5a8a7c92b9f33b27c2aebba802c64054831e72585878d6a"}
Jul 06 19:09:48.049211 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:48.049158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:48.100371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:48.100332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:50.424045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:50.423959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv" event={"ID":"c2aaa989-d930-4849-a6d1-4d4b921773ba","Type":"ContainerStarted","Data":"bf5f258cc1f8360b77684279fc975ce1fb456906f1d6e8d0353c671ee623773e"}
Jul 06 19:09:50.442793 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:50.442747    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lzfzv" podStartSLOduration=1.421275189 podStartE2EDuration="6.442731799s" totalImagesPullingTime="5.02145661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:50.441260824 +0000 UTC m=+262.873518660" watchObservedRunningTime="2026-07-06 19:09:50.442731799 +0000 UTC m=+262.874989624"
Jul 06 19:09:51.166614 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:51.166583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:51.271243 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:51.271202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:53.321642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:53.321611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:57.461460 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:57.461432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:09:57.530322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:09:57.530291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:13.355512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:13.355473    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:14.307196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.307164    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"]
Jul 06 19:10:14.314047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.314003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.318720 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.318695    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:10:14.318913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.318739    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:10:14.318913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.318739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:10:14.318913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.318834    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2b6f\""
Jul 06 19:10:14.319144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.318981    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:10:14.325281 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.325244    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"]
Jul 06 19:10:14.467324 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.467285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.467324 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.467326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.467747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.467347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.467747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.467429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.467747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.467474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pk4\" (UniqueName: \"kubernetes.io/projected/d7d67f66-2134-44c1-b694-727a94ce301b-kube-api-access-j5pk4\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.568709 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.568607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.568709 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.568661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.568709 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.568688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.569024 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.568727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.569024 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.568761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pk4\" (UniqueName: \"kubernetes.io/projected/d7d67f66-2134-44c1-b694-727a94ce301b-kube-api-access-j5pk4\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.569278 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.569257    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-manifests\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.571172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.571145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d67f66-2134-44c1-b694-727a94ce301b-tmp\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.571302 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.571287    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.571351 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.571323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d67f66-2134-44c1-b694-727a94ce301b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.577648 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.577624    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pk4\" (UniqueName: \"kubernetes.io/projected/d7d67f66-2134-44c1-b694-727a94ce301b-kube-api-access-j5pk4\") pod \"opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn\" (UID: \"d7d67f66-2134-44c1-b694-727a94ce301b\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.625662 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.625635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:14.773541 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.773508    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"]
Jul 06 19:10:14.777205 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:14.777180    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d67f66_2134_44c1_b694_727a94ce301b.slice/crio-6295104106e55ff82070df454aeba8ec1cb8ea96c703d40dc2dfd4dc1466f905 WatchSource:0}: Error finding container 6295104106e55ff82070df454aeba8ec1cb8ea96c703d40dc2dfd4dc1466f905: Status 404 returned error can't find the container with id 6295104106e55ff82070df454aeba8ec1cb8ea96c703d40dc2dfd4dc1466f905
Jul 06 19:10:14.892424 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:14.892394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:15.520650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:15.520615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn" event={"ID":"d7d67f66-2134-44c1-b694-727a94ce301b","Type":"ContainerStarted","Data":"6295104106e55ff82070df454aeba8ec1cb8ea96c703d40dc2dfd4dc1466f905"}
Jul 06 19:10:18.536850 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:18.536813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn" event={"ID":"d7d67f66-2134-44c1-b694-727a94ce301b","Type":"ContainerStarted","Data":"09451d212a1eb592dcee3ef34ef669e18371322d7080c89a402f0bdb6d5bb1d0"}
Jul 06 19:10:19.543042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:19.543005    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7d67f66-2134-44c1-b694-727a94ce301b" containerID="09451d212a1eb592dcee3ef34ef669e18371322d7080c89a402f0bdb6d5bb1d0" exitCode=0
Jul 06 19:10:19.543463 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:19.543090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn" event={"ID":"d7d67f66-2134-44c1-b694-727a94ce301b","Type":"ContainerDied","Data":"09451d212a1eb592dcee3ef34ef669e18371322d7080c89a402f0bdb6d5bb1d0"}
Jul 06 19:10:20.549105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:20.549075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn" event={"ID":"d7d67f66-2134-44c1-b694-727a94ce301b","Type":"ContainerStarted","Data":"3b3dc23a86225dc7b5695c01150fd73cdfc1d80563c98e33d136d2fcad28e129"}
Jul 06 19:10:20.549495 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:20.549172    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:20.572273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:20.572225    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn" podStartSLOduration=2.14242824 podStartE2EDuration="6.572209742s" totalImagesPullingTime="3.361273618s" totalInitContainerRuntime="1.068507884s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:20.571096934 +0000 UTC m=+293.003354757" watchObservedRunningTime="2026-07-06 19:10:20.572209742 +0000 UTC m=+293.004467565"
Jul 06 19:10:26.137167 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:26.137125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:26.232360 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:26.232324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:27.961595 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:27.961562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:10:27.967421 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:27.967398    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:10:27.967994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:27.967973    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:10:31.555384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:31.555353    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn"
Jul 06 19:10:33.391628 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:33.391588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:33.545864 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:33.545825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:33.879066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:33.879030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:33.993207 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:33.993169    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"]
Jul 06 19:10:33.995649 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:33.995624    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.000995 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.000967    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8rxxj\""
Jul 06 19:10:34.001152 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.000976    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:10:34.001152 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.000976    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:10:34.002706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.002454    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:10:34.002706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.002474    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:10:34.028860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.028823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"]
Jul 06 19:10:34.039452 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.039423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hng5s\" (UniqueName: \"kubernetes.io/projected/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-kube-api-access-hng5s\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.039609 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.039527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tmp\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.039609 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.039553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tls-certs\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.054402 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.054365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:34.140260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.140163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tmp\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.140260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.140205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tls-certs\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.140507 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.140263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hng5s\" (UniqueName: \"kubernetes.io/projected/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-kube-api-access-hng5s\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.142886 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.142857    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tmp\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.143045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.143026    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-tls-certs\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.156082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.156053    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hng5s\" (UniqueName: \"kubernetes.io/projected/d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5-kube-api-access-hng5s\") pod \"kube-auth-proxy-5d5b9884b5-lkmf2\" (UID: \"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5\") " pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.264867 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.264829    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgrgq"]
Jul 06 19:10:34.267577 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.267553    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.271241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.271208    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:10:34.271348 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.271250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lcwxv\""
Jul 06 19:10:34.287527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.287487    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgrgq"]
Jul 06 19:10:34.305187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.305160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"
Jul 06 19:10:34.335049 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.335014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:34.341346 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.341318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxs9z\" (UniqueName: \"kubernetes.io/projected/e19b169b-f1e8-4f87-88f8-dd32b20043c0-kube-api-access-dxs9z\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.341493 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.341358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.442119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.442079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxs9z\" (UniqueName: \"kubernetes.io/projected/e19b169b-f1e8-4f87-88f8-dd32b20043c0-kube-api-access-dxs9z\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.442119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.442125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.442533 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:34.442252    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:10:34.442533 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:34.442304    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert podName:e19b169b-f1e8-4f87-88f8-dd32b20043c0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:34.942287312 +0000 UTC m=+307.374545114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert") pod "odh-model-controller-7998c67dc4-jgrgq" (UID: "e19b169b-f1e8-4f87-88f8-dd32b20043c0") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:10:34.447442 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.447412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:34.466585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.466549    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxs9z\" (UniqueName: \"kubernetes.io/projected/e19b169b-f1e8-4f87-88f8-dd32b20043c0-kube-api-access-dxs9z\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.483962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.483914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2"]
Jul 06 19:10:34.491941 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:34.491902    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a45ef7_9d3d_48f4_b2ed_5331cbdf55e5.slice/crio-f76db59176eaedfa96cde6d5d5f22e3ecf72efd35fa1497be40d66c9e9944292 WatchSource:0}: Error finding container f76db59176eaedfa96cde6d5d5f22e3ecf72efd35fa1497be40d66c9e9944292: Status 404 returned error can't find the container with id f76db59176eaedfa96cde6d5d5f22e3ecf72efd35fa1497be40d66c9e9944292
Jul 06 19:10:34.493732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.493717    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:10:34.611169 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.611124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2" event={"ID":"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5","Type":"ContainerStarted","Data":"f76db59176eaedfa96cde6d5d5f22e3ecf72efd35fa1497be40d66c9e9944292"}
Jul 06 19:10:34.638790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.638750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:34.736021 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.735905    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:34.946296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.946262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:34.948706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:34.948675    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e19b169b-f1e8-4f87-88f8-dd32b20043c0-cert\") pod \"odh-model-controller-7998c67dc4-jgrgq\" (UID: \"e19b169b-f1e8-4f87-88f8-dd32b20043c0\") " pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:35.181497 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.181462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:35.352598 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.352313    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jgrgq"]
Jul 06 19:10:35.355599 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:35.355565    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19b169b_f1e8_4f87_88f8_dd32b20043c0.slice/crio-7637524ba97a90915b4badd42af6f739855c54d0c630cffb1ce40679ade301e3 WatchSource:0}: Error finding container 7637524ba97a90915b4badd42af6f739855c54d0c630cffb1ce40679ade301e3: Status 404 returned error can't find the container with id 7637524ba97a90915b4badd42af6f739855c54d0c630cffb1ce40679ade301e3
Jul 06 19:10:35.419783 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.419750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:35.431492 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.431467    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4xql6"]
Jul 06 19:10:35.434330 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.434285    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.437976 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.437953    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:10:35.451555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.451399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9d0d4c-58ef-4785-8675-5518a7dd2503-tls-certs\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.451555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.451437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bw2h\" (UniqueName: \"kubernetes.io/projected/3f9d0d4c-58ef-4785-8675-5518a7dd2503-kube-api-access-2bw2h\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.453575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.453550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4xql6"]
Jul 06 19:10:35.552337 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.552304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9d0d4c-58ef-4785-8675-5518a7dd2503-tls-certs\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.552337 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.552339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bw2h\" (UniqueName: \"kubernetes.io/projected/3f9d0d4c-58ef-4785-8675-5518a7dd2503-kube-api-access-2bw2h\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.554699 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.554669    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9d0d4c-58ef-4785-8675-5518a7dd2503-tls-certs\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.562614 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.562590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bw2h\" (UniqueName: \"kubernetes.io/projected/3f9d0d4c-58ef-4785-8675-5518a7dd2503-kube-api-access-2bw2h\") pod \"model-serving-api-54d89bd5fc-4xql6\" (UID: \"3f9d0d4c-58ef-4785-8675-5518a7dd2503\") " pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.589818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.589774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:35.616860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.616831    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq" event={"ID":"e19b169b-f1e8-4f87-88f8-dd32b20043c0","Type":"ContainerStarted","Data":"7637524ba97a90915b4badd42af6f739855c54d0c630cffb1ce40679ade301e3"}
Jul 06 19:10:35.744960 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.744840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:35.751804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.749063    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:35.753093 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.753066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.753687 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.753654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:35.753942 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.753904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754067 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8cs\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.754342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.754267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.756043 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.756023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:10:35.756164 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.756111    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:10:35.756164 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.756121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:10:35.756164 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.756158    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zppv7\""
Jul 06 19:10:35.756309 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.756121    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:10:35.764171 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.764150    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:35.822528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.822482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:35.855264 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855438 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855438 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8cs\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855752 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.855968 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.855941    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.858279 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.858259    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.858401 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.858377    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.858469 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.858397    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.858469 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.858424    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.864241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.864210    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8cs\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.864650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.864629    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token\") pod \"istiod-openshift-gateway-7574459656-bv9wh\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:35.880899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:35.880724    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4xql6"]
Jul 06 19:10:35.882897 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:35.882873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9d0d4c_58ef_4785_8675_5518a7dd2503.slice/crio-b883430bb5b1c1b25300817bd8dc73a0ebf908efc2e91e0b7b8fbc480c94ed31 WatchSource:0}: Error finding container b883430bb5b1c1b25300817bd8dc73a0ebf908efc2e91e0b7b8fbc480c94ed31: Status 404 returned error can't find the container with id b883430bb5b1c1b25300817bd8dc73a0ebf908efc2e91e0b7b8fbc480c94ed31
Jul 06 19:10:36.065428 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:36.065347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:36.237643 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:36.237607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:36.241548 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:36.241509    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fc63f4_5ea6_45c0_b958_9586eec9d478.slice/crio-dc86da90339a1244da48dc9450f7562f1fa246993a5689f4582a1f3be737508c WatchSource:0}: Error finding container dc86da90339a1244da48dc9450f7562f1fa246993a5689f4582a1f3be737508c: Status 404 returned error can't find the container with id dc86da90339a1244da48dc9450f7562f1fa246993a5689f4582a1f3be737508c
Jul 06 19:10:36.624090 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:36.624048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" event={"ID":"81fc63f4-5ea6-45c0-b958-9586eec9d478","Type":"ContainerStarted","Data":"dc86da90339a1244da48dc9450f7562f1fa246993a5689f4582a1f3be737508c"}
Jul 06 19:10:36.625382 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:36.625346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6" event={"ID":"3f9d0d4c-58ef-4785-8675-5518a7dd2503","Type":"ContainerStarted","Data":"b883430bb5b1c1b25300817bd8dc73a0ebf908efc2e91e0b7b8fbc480c94ed31"}
Jul 06 19:10:36.907573 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:36.907293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:40.654183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:40.654125    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:10:40.654545 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:40.654214    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:10:41.607553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.607519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:41.654531 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.654462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" event={"ID":"81fc63f4-5ea6-45c0-b958-9586eec9d478","Type":"ContainerStarted","Data":"4ad47387337608c4fabde5749cf869695b03fa02c5c50e9e37ca1cfe7f71e840"}
Jul 06 19:10:41.655046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.654587    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:41.656429 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.656401    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bv9wh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:10:41.656565 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.656448    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:10:41.656635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.656564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq" event={"ID":"e19b169b-f1e8-4f87-88f8-dd32b20043c0","Type":"ContainerStarted","Data":"e43a6c0e6016341d4e414cf7c9ca1b3703805102711d1bf5c8a761d870b36e2e"}
Jul 06 19:10:41.656706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.656639    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:41.658188 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.658164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2" event={"ID":"d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5","Type":"ContainerStarted","Data":"7121a7b5ed1b1f322460ce1bd6c2586a1c7df191153eed1799b78f5202aa88af"}
Jul 06 19:10:41.659864 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.659837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6" event={"ID":"3f9d0d4c-58ef-4785-8675-5518a7dd2503","Type":"ContainerStarted","Data":"e8795d4f4e2dd3472dcc0c33e554bfd8f6bdc23a355a91de0793404a7edf7d10"}
Jul 06 19:10:41.659999 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.659977    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:10:41.708241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.708192    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" podStartSLOduration=2.29944348 podStartE2EDuration="6.708178365s" totalImagesPullingTime="4.408734885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:41.706107686 +0000 UTC m=+314.138365513" watchObservedRunningTime="2026-07-06 19:10:41.708178365 +0000 UTC m=+314.140436188"
Jul 06 19:10:41.758218 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.758182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:41.759027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.758980    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6" podStartSLOduration=1.9993366529999999 podStartE2EDuration="6.758963875s" totalImagesPullingTime="4.759627222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:41.754376258 +0000 UTC m=+314.186634110" watchObservedRunningTime="2026-07-06 19:10:41.758963875 +0000 UTC m=+314.191221699"
Jul 06 19:10:41.783871 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.783821    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq" podStartSLOduration=2.477963709 podStartE2EDuration="7.783803164s" totalImagesPullingTime="5.305839455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:41.78185261 +0000 UTC m=+314.214110436" watchObservedRunningTime="2026-07-06 19:10:41.783803164 +0000 UTC m=+314.216060989"
Jul 06 19:10:41.813291 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:41.813239    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d5b9884b5-lkmf2" podStartSLOduration=2.65278984 podStartE2EDuration="8.81322161s" totalImagesPullingTime="6.16043177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:41.811574411 +0000 UTC m=+314.243832248" watchObservedRunningTime="2026-07-06 19:10:41.81322161 +0000 UTC m=+314.245479433"
Jul 06 19:10:42.388634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.388570    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"]
Jul 06 19:10:42.392068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.392051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.395407 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.395384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pngzt\""
Jul 06 19:10:42.408472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.408449    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"]
Jul 06 19:10:42.416031 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg7qr\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-kube-api-access-jg7qr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416292 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416366 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416401 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f224f-d6cf-49ca-8c0d-d131c466d457-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.416439 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.416416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.431386 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.431358    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:42.517605 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg7qr\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-kube-api-access-jg7qr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.517803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.517803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.517803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.517803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.517803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.517773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518093    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518291 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f224f-d6cf-49ca-8c0d-d131c466d457-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518291 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518194    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518291 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518406 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518290    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.518720 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.518698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/759f224f-d6cf-49ca-8c0d-d131c466d457-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.520214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.520197    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.520278 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.520221    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.527337 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.527309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.527467 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.527452    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg7qr\" (UniqueName: \"kubernetes.io/projected/759f224f-d6cf-49ca-8c0d-d131c466d457-kube-api-access-jg7qr\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47r54q\" (UID: \"759f224f-d6cf-49ca-8c0d-d131c466d457\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.664447 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.664373    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:42.702323 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.702288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:42.704039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.704004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:42.853079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.853054    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"]
Jul 06 19:10:42.855019 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:42.854970    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759f224f_d6cf_49ca_8c0d_d131c466d457.slice/crio-239b83487fc293a8cf45456c38fa3634042a4dcea4c9cdb62300e26d089f03ba WatchSource:0}: Error finding container 239b83487fc293a8cf45456c38fa3634042a4dcea4c9cdb62300e26d089f03ba: Status 404 returned error can't find the container with id 239b83487fc293a8cf45456c38fa3634042a4dcea4c9cdb62300e26d089f03ba
Jul 06 19:10:42.895751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:42.895712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:43.673630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:43.671947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q" event={"ID":"759f224f-d6cf-49ca-8c0d-d131c466d457","Type":"ContainerStarted","Data":"239b83487fc293a8cf45456c38fa3634042a4dcea4c9cdb62300e26d089f03ba"}
Jul 06 19:10:44.435548 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.435499    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:44.498352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.498321    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"]
Jul 06 19:10:44.501445 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.501425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.502336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.502311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"]
Jul 06 19:10:44.504225 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.504192    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-flm5n\""
Jul 06 19:10:44.504469 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.504453    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 19:10:44.505855 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.505837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.508387 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.508369    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 19:10:44.508466 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.508397    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cvkn5\""
Jul 06 19:10:44.513100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.512997    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"]
Jul 06 19:10:44.517201 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.517178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"]
Jul 06 19:10:44.537535 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.537283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmmjw\" (UniqueName: \"kubernetes.io/projected/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-kube-api-access-pmmjw\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.537535 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.537360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.537535 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.537389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6n6j\" (UniqueName: \"kubernetes.io/projected/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-kube-api-access-p6n6j\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.537535 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.537426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.638852 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.638818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmmjw\" (UniqueName: \"kubernetes.io/projected/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-kube-api-access-pmmjw\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.639079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.638882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.639079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.638917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n6j\" (UniqueName: \"kubernetes.io/projected/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-kube-api-access-p6n6j\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.639079 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.638976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.639079 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:44.639043    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 19:10:44.639292 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:44.639111    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert podName:eeb2f0cf-2d02-4212-b7d6-00d283970ef5 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:45.139093688 +0000 UTC m=+317.571351500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert") pod "kserve-controller-manager-d6f4b65b8-9rxx8" (UID: "eeb2f0cf-2d02-4212-b7d6-00d283970ef5") : secret "kserve-webhook-server-cert" not found
Jul 06 19:10:44.639292 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:44.639180    2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 19:10:44.639292 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:10:44.639245    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert podName:78e1d0d2-8215-4ecd-bfda-e2c20a48e013 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:45.139226904 +0000 UTC m=+317.571484727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert") pod "llmisvc-controller-manager-777c6bd7d5-g82dp" (UID: "78e1d0d2-8215-4ecd-bfda-e2c20a48e013") : secret "llmisvc-webhook-server-cert" not found
Jul 06 19:10:44.655236 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.655204    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6n6j\" (UniqueName: \"kubernetes.io/projected/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-kube-api-access-p6n6j\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:44.655679 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.655656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmmjw\" (UniqueName: \"kubernetes.io/projected/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-kube-api-access-pmmjw\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:44.863334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.863306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:44.963555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:44.963520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:45.075295 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.075251    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:45.143664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.143582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:45.143664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.143647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:45.146984 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.146960    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78e1d0d2-8215-4ecd-bfda-e2c20a48e013-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g82dp\" (UID: \"78e1d0d2-8215-4ecd-bfda-e2c20a48e013\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:45.147128 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.147008    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb2f0cf-2d02-4212-b7d6-00d283970ef5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9rxx8\" (UID: \"eeb2f0cf-2d02-4212-b7d6-00d283970ef5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:45.417046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.416966    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:45.426118 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.426090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:45.580845 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.580802    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:10:45.581028 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.580891    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:10:45.581028 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.580950    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:10:45.646858 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.646835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"]
Jul 06 19:10:45.650222 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:45.650197    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb2f0cf_2d02_4212_b7d6_00d283970ef5.slice/crio-7dd95183af766155ba0617613a666204d2369238dbcb2622998bb0d1d4329f98 WatchSource:0}: Error finding container 7dd95183af766155ba0617613a666204d2369238dbcb2622998bb0d1d4329f98: Status 404 returned error can't find the container with id 7dd95183af766155ba0617613a666204d2369238dbcb2622998bb0d1d4329f98
Jul 06 19:10:45.669916 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.669892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"]
Jul 06 19:10:45.671785 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:10:45.671761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78e1d0d2_8215_4ecd_bfda_e2c20a48e013.slice/crio-15d6d2dcf791fdb5c8daf97c5f1f75dcc58c35984cd826ab15c77cf8cbde416c WatchSource:0}: Error finding container 15d6d2dcf791fdb5c8daf97c5f1f75dcc58c35984cd826ab15c77cf8cbde416c: Status 404 returned error can't find the container with id 15d6d2dcf791fdb5c8daf97c5f1f75dcc58c35984cd826ab15c77cf8cbde416c
Jul 06 19:10:45.683698 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.683674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8" event={"ID":"eeb2f0cf-2d02-4212-b7d6-00d283970ef5","Type":"ContainerStarted","Data":"7dd95183af766155ba0617613a666204d2369238dbcb2622998bb0d1d4329f98"}
Jul 06 19:10:45.684839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.684815    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp" event={"ID":"78e1d0d2-8215-4ecd-bfda-e2c20a48e013","Type":"ContainerStarted","Data":"15d6d2dcf791fdb5c8daf97c5f1f75dcc58c35984cd826ab15c77cf8cbde416c"}
Jul 06 19:10:45.686542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.686506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q" event={"ID":"759f224f-d6cf-49ca-8c0d-d131c466d457","Type":"ContainerStarted","Data":"03b0f0b66cb87dc80135f8b498f53d58c3745cfe3f861a214a4e2e808f8aa55d"}
Jul 06 19:10:45.695078 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.695054    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:45.702848 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.702828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:45.711285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.711235    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q" podStartSLOduration=0.989188164 podStartE2EDuration="3.711220031s" totalImagesPullingTime="2.722031867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:45.709693221 +0000 UTC m=+318.141951057" watchObservedRunningTime="2026-07-06 19:10:45.711220031 +0000 UTC m=+318.143477938"
Jul 06 19:10:45.812138 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.812104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:45.915517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:45.915490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:10:46.708706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:46.708675    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:47.697963 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:47.697915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:47.698901 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:47.698881    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47r54q"
Jul 06 19:10:48.968065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:48.968022    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:48.968559 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:48.968288    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerName="discovery" containerID="cri-o://4ad47387337608c4fabde5749cf869695b03fa02c5c50e9e37ca1cfe7f71e840" gracePeriod=30
Jul 06 19:10:49.709503 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.709469    2559 generic.go:356] "Generic (PLEG): container finished" podID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerID="4ad47387337608c4fabde5749cf869695b03fa02c5c50e9e37ca1cfe7f71e840" exitCode=0
Jul 06 19:10:49.709727 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.709541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" event={"ID":"81fc63f4-5ea6-45c0-b958-9586eec9d478","Type":"ContainerDied","Data":"4ad47387337608c4fabde5749cf869695b03fa02c5c50e9e37ca1cfe7f71e840"}
Jul 06 19:10:49.757407 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.757383    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:49.792717 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792684    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.792890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792732    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n8cs\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.792890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792763    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.792890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792797    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.792890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.793119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792895    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.793119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.792962    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert\") pod \"81fc63f4-5ea6-45c0-b958-9586eec9d478\" (UID: \"81fc63f4-5ea6-45c0-b958-9586eec9d478\") "
Jul 06 19:10:49.794513 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.794471    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:10:49.796574 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.796529    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token" (OuterVolumeSpecName: "istio-token") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:10:49.796702 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.796659    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:10:49.797378 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.797350    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs" (OuterVolumeSpecName: "local-certs") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:10:49.797490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.797396    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts" (OuterVolumeSpecName: "cacerts") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:10:49.797490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.797425    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs" (OuterVolumeSpecName: "kube-api-access-5n8cs") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "kube-api-access-5n8cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:10:49.798311 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.798290    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "81fc63f4-5ea6-45c0-b958-9586eec9d478" (UID: "81fc63f4-5ea6-45c0-b958-9586eec9d478"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:10:49.894114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894076    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-cacerts\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894107    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n8cs\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-kube-api-access-5n8cs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894118    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894128    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81fc63f4-5ea6-45c0-b958-9586eec9d478-local-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894136    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-kubeconfig\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894144    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-ca-configmap\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:49.894408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:49.894152    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81fc63f4-5ea6-45c0-b958-9586eec9d478-istio-csr-dns-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:10:50.715415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.715313    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"
Jul 06 19:10:50.715415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.715337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh" event={"ID":"81fc63f4-5ea6-45c0-b958-9586eec9d478","Type":"ContainerDied","Data":"dc86da90339a1244da48dc9450f7562f1fa246993a5689f4582a1f3be737508c"}
Jul 06 19:10:50.715415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.715397    2559 scope.go:117] "RemoveContainer" containerID="4ad47387337608c4fabde5749cf869695b03fa02c5c50e9e37ca1cfe7f71e840"
Jul 06 19:10:50.717123 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.717089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8" event={"ID":"eeb2f0cf-2d02-4212-b7d6-00d283970ef5","Type":"ContainerStarted","Data":"acfda8036bb40870c992353d2ca8c7c1db68a57190eb8b410ac95686b138a637"}
Jul 06 19:10:50.717238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.717158    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:10:50.719119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.719099    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp" event={"ID":"78e1d0d2-8215-4ecd-bfda-e2c20a48e013","Type":"ContainerStarted","Data":"af91b67891c77ece4e5aaec8db484272bbee814357f90b71ed5cf201cbbed464"}
Jul 06 19:10:50.719205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.719144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:10:50.739340 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.739290    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp" podStartSLOduration=2.084033016 podStartE2EDuration="6.73927435s" totalImagesPullingTime="4.655241334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.738446796 +0000 UTC m=+323.170704641" watchObservedRunningTime="2026-07-06 19:10:50.73927435 +0000 UTC m=+323.171532151"
Jul 06 19:10:50.752805 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.752778    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:50.756421 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.756395    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bv9wh"]
Jul 06 19:10:50.770794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:50.770749    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8" podStartSLOduration=2.0923548849999998 podStartE2EDuration="6.77073631s" totalImagesPullingTime="4.678381425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.77015663 +0000 UTC m=+323.202414454" watchObservedRunningTime="2026-07-06 19:10:50.77073631 +0000 UTC m=+323.202994131"
Jul 06 19:10:52.143562 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:52.143523    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" path="/var/lib/kubelet/pods/81fc63f4-5ea6-45c0-b958-9586eec9d478/volumes"
Jul 06 19:10:52.666438 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:52.666403    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jgrgq"
Jul 06 19:10:52.668635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:10:52.668612    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4xql6"
Jul 06 19:11:11.816119 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:11.816085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:11.912711 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:11.912676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:13.745238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:13.745196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:19.279180 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:19.279098    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:19.328786 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:19.328753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:21.726584 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:21.726555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g82dp"
Jul 06 19:11:21.729656 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:21.729636    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9rxx8"
Jul 06 19:11:28.591819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:28.591783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:28.644082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:28.644048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:34.967700 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:34.967661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:35.063408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.063374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:35.091103 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.091074    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:35.091534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.091516    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerName="discovery"
Jul 06 19:11:35.091649 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.091536    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerName="discovery"
Jul 06 19:11:35.091649 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.091634    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fc63f4-5ea6-45c0-b958-9586eec9d478" containerName="discovery"
Jul 06 19:11:35.099788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.099764    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:35.103376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.103352    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:11:35.103502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.103399    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jl5c2\""
Jul 06 19:11:35.103502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.103481    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:11:35.108542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.108464    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:35.150839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.150806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:35.197846 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.197816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mgw\" (UniqueName: \"kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw\") pod \"kuadrant-operator-catalog-pddrh\" (UID: \"36b08324-60bb-445d-b1b5-f986bf45cb2f\") " pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:35.299351 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.299274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mgw\" (UniqueName: \"kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw\") pod \"kuadrant-operator-catalog-pddrh\" (UID: \"36b08324-60bb-445d-b1b5-f986bf45cb2f\") " pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:35.309039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.309016    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mgw\" (UniqueName: \"kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw\") pod \"kuadrant-operator-catalog-pddrh\" (UID: \"36b08324-60bb-445d-b1b5-f986bf45cb2f\") " pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:35.411147 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.411123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:35.442634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.442602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:35.541821 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.541799    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:35.543751 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:11:35.543725    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b08324_60bb_445d_b1b5_f986bf45cb2f.slice/crio-6b5ce906fb00870f3b9e9ca0754334feba75ff39985d53e56d99c52f928f6cbb WatchSource:0}: Error finding container 6b5ce906fb00870f3b9e9ca0754334feba75ff39985d53e56d99c52f928f6cbb: Status 404 returned error can't find the container with id 6b5ce906fb00870f3b9e9ca0754334feba75ff39985d53e56d99c52f928f6cbb
Jul 06 19:11:35.656912 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.656884    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc894"]
Jul 06 19:11:35.660339 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.660321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:35.673037 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.673014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc894"]
Jul 06 19:11:35.702037 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.702001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srlmg\" (UniqueName: \"kubernetes.io/projected/bca70ce6-acac-4974-86dd-b89d036f2cf0-kube-api-access-srlmg\") pod \"kuadrant-operator-catalog-gc894\" (UID: \"bca70ce6-acac-4974-86dd-b89d036f2cf0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:35.803308 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.803270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srlmg\" (UniqueName: \"kubernetes.io/projected/bca70ce6-acac-4974-86dd-b89d036f2cf0-kube-api-access-srlmg\") pod \"kuadrant-operator-catalog-gc894\" (UID: \"bca70ce6-acac-4974-86dd-b89d036f2cf0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:35.812461 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.812431    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srlmg\" (UniqueName: \"kubernetes.io/projected/bca70ce6-acac-4974-86dd-b89d036f2cf0-kube-api-access-srlmg\") pod \"kuadrant-operator-catalog-gc894\" (UID: \"bca70ce6-acac-4974-86dd-b89d036f2cf0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:35.881062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.881024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:35.932060 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.931954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" event={"ID":"36b08324-60bb-445d-b1b5-f986bf45cb2f","Type":"ContainerStarted","Data":"6b5ce906fb00870f3b9e9ca0754334feba75ff39985d53e56d99c52f928f6cbb"}
Jul 06 19:11:35.969176 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:35.969133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:36.086617 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:36.086582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:11:36.112642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:36.112615    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc894"]
Jul 06 19:11:36.115111 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:11:36.115084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca70ce6_acac_4974_86dd_b89d036f2cf0.slice/crio-a8b503f45270cfd794b53f7af131cd9186aac17fd9ebde7f06624194a897aedf WatchSource:0}: Error finding container a8b503f45270cfd794b53f7af131cd9186aac17fd9ebde7f06624194a897aedf: Status 404 returned error can't find the container with id a8b503f45270cfd794b53f7af131cd9186aac17fd9ebde7f06624194a897aedf
Jul 06 19:11:36.938455 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:36.938416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc894" event={"ID":"bca70ce6-acac-4974-86dd-b89d036f2cf0","Type":"ContainerStarted","Data":"a8b503f45270cfd794b53f7af131cd9186aac17fd9ebde7f06624194a897aedf"}
Jul 06 19:11:38.949000 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:38.948958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" event={"ID":"36b08324-60bb-445d-b1b5-f986bf45cb2f","Type":"ContainerStarted","Data":"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"}
Jul 06 19:11:38.949498 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:38.949024    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" podUID="36b08324-60bb-445d-b1b5-f986bf45cb2f" containerName="registry-server" containerID="cri-o://5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448" gracePeriod=2
Jul 06 19:11:38.950453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:38.950428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc894" event={"ID":"bca70ce6-acac-4974-86dd-b89d036f2cf0","Type":"ContainerStarted","Data":"61425477403c233b38b7d8845f427a180986cc6c1333603da437f704627b0109"}
Jul 06 19:11:38.974830 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:38.974790    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" podStartSLOduration=1.561019864 podStartE2EDuration="3.974776126s" totalImagesPullingTime="2.413756262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:38.973194702 +0000 UTC m=+371.405452527" watchObservedRunningTime="2026-07-06 19:11:38.974776126 +0000 UTC m=+371.407033949"
Jul 06 19:11:38.996159 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:38.996121    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gc894" podStartSLOduration=2.15721938 podStartE2EDuration="3.996107082s" totalImagesPullingTime="1.838887702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:38.995747905 +0000 UTC m=+371.428005739" watchObservedRunningTime="2026-07-06 19:11:38.996107082 +0000 UTC m=+371.428364905"
Jul 06 19:11:39.190678 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.190647    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:39.236747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.236674    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2mgw\" (UniqueName: \"kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw\") pod \"36b08324-60bb-445d-b1b5-f986bf45cb2f\" (UID: \"36b08324-60bb-445d-b1b5-f986bf45cb2f\") "
Jul 06 19:11:39.239045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.239015    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw" (OuterVolumeSpecName: "kube-api-access-p2mgw") pod "36b08324-60bb-445d-b1b5-f986bf45cb2f" (UID: "36b08324-60bb-445d-b1b5-f986bf45cb2f"). InnerVolumeSpecName "kube-api-access-p2mgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:11:39.338369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.338338    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2mgw\" (UniqueName: \"kubernetes.io/projected/36b08324-60bb-445d-b1b5-f986bf45cb2f-kube-api-access-p2mgw\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:11:39.956898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.956867    2559 generic.go:356] "Generic (PLEG): container finished" podID="36b08324-60bb-445d-b1b5-f986bf45cb2f" containerID="5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448" exitCode=0
Jul 06 19:11:39.957349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.956909    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pddrh"
Jul 06 19:11:39.957349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.956961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" event={"ID":"36b08324-60bb-445d-b1b5-f986bf45cb2f","Type":"ContainerDied","Data":"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"}
Jul 06 19:11:39.957349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.957017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pddrh" event={"ID":"36b08324-60bb-445d-b1b5-f986bf45cb2f","Type":"ContainerDied","Data":"6b5ce906fb00870f3b9e9ca0754334feba75ff39985d53e56d99c52f928f6cbb"}
Jul 06 19:11:39.957349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.957039    2559 scope.go:117] "RemoveContainer" containerID="5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"
Jul 06 19:11:39.965914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.965897    2559 scope.go:117] "RemoveContainer" containerID="5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"
Jul 06 19:11:39.966198 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:11:39.966180    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448\": container with ID starting with 5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448 not found: ID does not exist" containerID="5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"
Jul 06 19:11:39.966245 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.966206    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448"} err="failed to get container status \"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448\": rpc error: code = NotFound desc = could not find container \"5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448\": container with ID starting with 5db2c21429e5c1288a49b923c16ea63a7891ccc38aa872cd151a7a275271e448 not found: ID does not exist"
Jul 06 19:11:39.979537 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.979520    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:39.981539 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:39.981518    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pddrh"]
Jul 06 19:11:40.141557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:40.141525    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b08324-60bb-445d-b1b5-f986bf45cb2f" path="/var/lib/kubelet/pods/36b08324-60bb-445d-b1b5-f986bf45cb2f/volumes"
Jul 06 19:11:45.969797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:45.969766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:45.970312 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:45.969819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:45.992988 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:45.992962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:11:46.014319 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:11:46.014294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gc894"
Jul 06 19:12:00.567237 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:00.567161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:01.047340 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:01.047305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:01.146625 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:01.146595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:01.285218 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:01.285179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:01.774251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:01.774217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:01.877001 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:01.876962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:02.207161 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:02.207127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:02.307512 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:02.307480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:04.481487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.479640    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"]
Jul 06 19:12:04.481487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.480256    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b08324-60bb-445d-b1b5-f986bf45cb2f" containerName="registry-server"
Jul 06 19:12:04.481487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.480275    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b08324-60bb-445d-b1b5-f986bf45cb2f" containerName="registry-server"
Jul 06 19:12:04.481487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.480355    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b08324-60bb-445d-b1b5-f986bf45cb2f" containerName="registry-server"
Jul 06 19:12:04.483465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.483404    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:04.489436 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.489414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qb6l5\""
Jul 06 19:12:04.502678 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.502653    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"]
Jul 06 19:12:04.660993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.660959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4gz8\" (UniqueName: \"kubernetes.io/projected/2c0dbe84-4e77-4dac-819c-23b4061f2acd-kube-api-access-d4gz8\") pod \"authorino-operator-75cc8d5cb7-9rvw5\" (UID: \"2c0dbe84-4e77-4dac-819c-23b4061f2acd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:04.762460 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.762376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4gz8\" (UniqueName: \"kubernetes.io/projected/2c0dbe84-4e77-4dac-819c-23b4061f2acd-kube-api-access-d4gz8\") pod \"authorino-operator-75cc8d5cb7-9rvw5\" (UID: \"2c0dbe84-4e77-4dac-819c-23b4061f2acd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:04.775992 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.775958    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4gz8\" (UniqueName: \"kubernetes.io/projected/2c0dbe84-4e77-4dac-819c-23b4061f2acd-kube-api-access-d4gz8\") pod \"authorino-operator-75cc8d5cb7-9rvw5\" (UID: \"2c0dbe84-4e77-4dac-819c-23b4061f2acd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:04.798430 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.798400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:04.930051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:04.930029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"]
Jul 06 19:12:04.932674 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:04.932644    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0dbe84_4e77_4dac_819c_23b4061f2acd.slice/crio-0840652e7649d67753513c5d7bd79fc245c0a05e71a3b23d1d39e485c5d5f543 WatchSource:0}: Error finding container 0840652e7649d67753513c5d7bd79fc245c0a05e71a3b23d1d39e485c5d5f543: Status 404 returned error can't find the container with id 0840652e7649d67753513c5d7bd79fc245c0a05e71a3b23d1d39e485c5d5f543
Jul 06 19:12:05.080949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:05.080850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5" event={"ID":"2c0dbe84-4e77-4dac-819c-23b4061f2acd","Type":"ContainerStarted","Data":"0840652e7649d67753513c5d7bd79fc245c0a05e71a3b23d1d39e485c5d5f543"}
Jul 06 19:12:05.790532 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:05.790492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:07.821078 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.821053    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"]
Jul 06 19:12:07.824022 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.824007    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:07.826910 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.826887    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:12:07.827045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.827027    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mktjk\""
Jul 06 19:12:07.835237 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.835212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"]
Jul 06 19:12:07.995315 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:07.995278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkszv\" (UniqueName: \"kubernetes.io/projected/c84a26c9-b178-48be-9164-eb6fb58786c2-kube-api-access-kkszv\") pod \"dns-operator-controller-manager-864dd78c4c-f4kjk\" (UID: \"c84a26c9-b178-48be-9164-eb6fb58786c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:08.095912 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.095817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkszv\" (UniqueName: \"kubernetes.io/projected/c84a26c9-b178-48be-9164-eb6fb58786c2-kube-api-access-kkszv\") pod \"dns-operator-controller-manager-864dd78c4c-f4kjk\" (UID: \"c84a26c9-b178-48be-9164-eb6fb58786c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:08.096851 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.096827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5" event={"ID":"2c0dbe84-4e77-4dac-819c-23b4061f2acd","Type":"ContainerStarted","Data":"0c4888d4f836a6cb2f5c8480231f56686eab76c5d0c9fc993e899038ca5dfc48"}
Jul 06 19:12:08.096976 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.096958    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:08.105753 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.105735    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkszv\" (UniqueName: \"kubernetes.io/projected/c84a26c9-b178-48be-9164-eb6fb58786c2-kube-api-access-kkszv\") pod \"dns-operator-controller-manager-864dd78c4c-f4kjk\" (UID: \"c84a26c9-b178-48be-9164-eb6fb58786c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:08.117243 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.117194    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5" podStartSLOduration=1.253095957 podStartE2EDuration="4.117175952s" totalImagesPullingTime="2.864079995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:08.115873545 +0000 UTC m=+400.548131379" watchObservedRunningTime="2026-07-06 19:12:08.117175952 +0000 UTC m=+400.549433776"
Jul 06 19:12:08.150776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.150750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:08.279740 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.279715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"]
Jul 06 19:12:08.281781 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:08.281751    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84a26c9_b178_48be_9164_eb6fb58786c2.slice/crio-d255845b46739957e6b616da1f96121cbd7d6b1a04fb3b3531fd03190dcfc41d WatchSource:0}: Error finding container d255845b46739957e6b616da1f96121cbd7d6b1a04fb3b3531fd03190dcfc41d: Status 404 returned error can't find the container with id d255845b46739957e6b616da1f96121cbd7d6b1a04fb3b3531fd03190dcfc41d
Jul 06 19:12:08.981741 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:08.981697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:09.105834 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:09.105797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk" event={"ID":"c84a26c9-b178-48be-9164-eb6fb58786c2","Type":"ContainerStarted","Data":"d255845b46739957e6b616da1f96121cbd7d6b1a04fb3b3531fd03190dcfc41d"}
Jul 06 19:12:09.226317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:09.226278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:11.120009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.119895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk" event={"ID":"c84a26c9-b178-48be-9164-eb6fb58786c2","Type":"ContainerStarted","Data":"faa859df23f5b93fdfc42012e1916715d0e2d0c61a5e72dcb6ca9ea0b0f0c891"}
Jul 06 19:12:11.120009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.119981    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:11.143326 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.143278    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk" podStartSLOduration=1.556282575 podStartE2EDuration="4.143262002s" totalImagesPullingTime="2.586979427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:11.141951223 +0000 UTC m=+403.574209077" watchObservedRunningTime="2026-07-06 19:12:11.143262002 +0000 UTC m=+403.575520072"
Jul 06 19:12:11.207052 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.207017    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"]
Jul 06 19:12:11.209972 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.209950    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:11.213015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.212999    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6flcz\""
Jul 06 19:12:11.220048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.220029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"]
Jul 06 19:12:11.327697 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.327666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n27b6\" (UniqueName: \"kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6\") pod \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" (UID: \"c23c141c-3e55-4c42-a52f-845bd8d7104b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:11.428798 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.428710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n27b6\" (UniqueName: \"kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6\") pod \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" (UID: \"c23c141c-3e55-4c42-a52f-845bd8d7104b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:11.440936 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.440906    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n27b6\" (UniqueName: \"kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6\") pod \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" (UID: \"c23c141c-3e55-4c42-a52f-845bd8d7104b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:11.521143 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.521115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:11.621899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.621802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:11.688722 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.688701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"]
Jul 06 19:12:11.690793 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:11.690762    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23c141c_3e55_4c42_a52f_845bd8d7104b.slice/crio-8ac224aa163e2dab9b703e1ef2b5daae4ae6cc6f1fee2c6dc661885f43573ad6 WatchSource:0}: Error finding container 8ac224aa163e2dab9b703e1ef2b5daae4ae6cc6f1fee2c6dc661885f43573ad6: Status 404 returned error can't find the container with id 8ac224aa163e2dab9b703e1ef2b5daae4ae6cc6f1fee2c6dc661885f43573ad6
Jul 06 19:12:11.770173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:11.770140    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:12.126779 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:12.126748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z" event={"ID":"c23c141c-3e55-4c42-a52f-845bd8d7104b","Type":"ContainerStarted","Data":"8ac224aa163e2dab9b703e1ef2b5daae4ae6cc6f1fee2c6dc661885f43573ad6"}
Jul 06 19:12:12.334575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:12.334535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:12.693799 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:12.693768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:12.812914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:12.812879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:14.142270 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:14.142245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:14.142632 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:14.142287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z" event={"ID":"c23c141c-3e55-4c42-a52f-845bd8d7104b","Type":"ContainerStarted","Data":"9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9"}
Jul 06 19:12:14.172800 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:14.172752    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z" podStartSLOduration=1.6212091800000001 podStartE2EDuration="3.17273499s" totalImagesPullingTime="1.55152581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:14.171438827 +0000 UTC m=+406.603696663" watchObservedRunningTime="2026-07-06 19:12:14.17273499 +0000 UTC m=+406.604992813"
Jul 06 19:12:14.262196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:14.262158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:15.724567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.721649    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"]
Jul 06 19:12:15.726096 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.726060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.729582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.729560    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vk52n\""
Jul 06 19:12:15.740249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.740226    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"]
Jul 06 19:12:15.771471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.771445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtsl4\" (UniqueName: \"kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.771626 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.771494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.872068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.872028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtsl4\" (UniqueName: \"kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.872249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.872087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.872462 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.872444    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:15.881735 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:15.881706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtsl4\" (UniqueName: \"kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:16.037337 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:16.037260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:16.175323 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:16.175223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"]
Jul 06 19:12:16.177552 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:16.177529    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370be469_565b_4fea_aca8_f21771c7df58.slice/crio-a26a1125ca80b5aa339a5492a8124e259d66a4ed6db7e001a2f22f32d48d60c2 WatchSource:0}: Error finding container a26a1125ca80b5aa339a5492a8124e259d66a4ed6db7e001a2f22f32d48d60c2: Status 404 returned error can't find the container with id a26a1125ca80b5aa339a5492a8124e259d66a4ed6db7e001a2f22f32d48d60c2
Jul 06 19:12:16.799698 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:16.799658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:16.887694 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:16.887657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:16.987331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:16.987291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:17.090146 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:17.090022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:17.156796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:17.156764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz" event={"ID":"370be469-565b-4fea-aca8-f21771c7df58","Type":"ContainerStarted","Data":"a26a1125ca80b5aa339a5492a8124e259d66a4ed6db7e001a2f22f32d48d60c2"}
Jul 06 19:12:19.108487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:19.108452    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9rvw5"
Jul 06 19:12:20.175560 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:20.175521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz" event={"ID":"370be469-565b-4fea-aca8-f21771c7df58","Type":"ContainerStarted","Data":"362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0"}
Jul 06 19:12:20.175975 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:20.175613    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:20.201000 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:20.200944    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz" podStartSLOduration=1.594853042 podStartE2EDuration="5.200915892s" totalImagesPullingTime="3.60606285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:20.198750054 +0000 UTC m=+412.631007882" watchObservedRunningTime="2026-07-06 19:12:20.200915892 +0000 UTC m=+412.633173716"
Jul 06 19:12:20.576148 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:20.576031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:20.645534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:20.645482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:22.129395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:22.129362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4kjk"
Jul 06 19:12:22.739575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:22.739542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:23.224374 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:23.224342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:24.583405 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:24.583371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:24.685668 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:24.685630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:25.147239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:25.147207    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:28.434286 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:28.434229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:28.533416 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:28.533385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:31.183849 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:31.183816    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.224126 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.224092    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"]
Jul 06 19:12:33.224566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.224278    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz" podUID="370be469-565b-4fea-aca8-f21771c7df58" containerName="manager" containerID="cri-o://362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0" gracePeriod=2
Jul 06 19:12:33.233825 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.233798    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"]
Jul 06 19:12:33.246233 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.246207    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"]
Jul 06 19:12:33.246472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.246432    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" containerName="manager" containerID="cri-o://9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9" gracePeriod=2
Jul 06 19:12:33.250442 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.250409    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="370be469-565b-4fea-aca8-f21771c7df58" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.263126 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.263103    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"]
Jul 06 19:12:33.267508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.267485    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:33.267961 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.267913    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" containerName="manager"
Jul 06 19:12:33.267961 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.267943    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" containerName="manager"
Jul 06 19:12:33.268132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.267965    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370be469-565b-4fea-aca8-f21771c7df58" containerName="manager"
Jul 06 19:12:33.268132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.267971    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="370be469-565b-4fea-aca8-f21771c7df58" containerName="manager"
Jul 06 19:12:33.268132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.268032    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" containerName="manager"
Jul 06 19:12:33.268132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.268044    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="370be469-565b-4fea-aca8-f21771c7df58" containerName="manager"
Jul 06 19:12:33.270813 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.270799    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.281276 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.281236    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c23c141c-3e55-4c42-a52f-845bd8d7104b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-rzp9z\": pods \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.284232 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.284199    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.295006 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.294982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:33.316580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.316548    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"]
Jul 06 19:12:33.316819 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.316782    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="370be469-565b-4fea-aca8-f21771c7df58" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.319719 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.319703    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:33.331211 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.331177    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="370be469-565b-4fea-aca8-f21771c7df58" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.331336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.331280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv97k\" (UniqueName: \"kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.331412 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.331383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.335800 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.335775    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.346553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.346531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"]
Jul 06 19:12:33.432578 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.432535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjws\" (UniqueName: \"kubernetes.io/projected/12db7936-1058-46cb-ba97-d3953fa8a5a5-kube-api-access-lhjws\") pod \"limitador-operator-controller-manager-859d7b78bd-kfmdw\" (UID: \"12db7936-1058-46cb-ba97-d3953fa8a5a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:33.432742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.432603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.432742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.432691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv97k\" (UniqueName: \"kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.433391 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.433364    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.446682 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.446655    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv97k\" (UniqueName: \"kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whxcr\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.499721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.499699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.501672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.501651    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.502640 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.502614    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="370be469-565b-4fea-aca8-f21771c7df58" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.505018 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.504993    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.507434 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.507413    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pxswz\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="370be469-565b-4fea-aca8-f21771c7df58" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:33.509908 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:33.509888    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzp9z\" is forbidden: User \"system:node:ip-10-0-134-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-25.ec2.internal' and this object" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:33.534011 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.533986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjws\" (UniqueName: \"kubernetes.io/projected/12db7936-1058-46cb-ba97-d3953fa8a5a5-kube-api-access-lhjws\") pod \"limitador-operator-controller-manager-859d7b78bd-kfmdw\" (UID: \"12db7936-1058-46cb-ba97-d3953fa8a5a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:33.554625 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.554597    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjws\" (UniqueName: \"kubernetes.io/projected/12db7936-1058-46cb-ba97-d3953fa8a5a5-kube-api-access-lhjws\") pod \"limitador-operator-controller-manager-859d7b78bd-kfmdw\" (UID: \"12db7936-1058-46cb-ba97-d3953fa8a5a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:33.634327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.634293    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n27b6\" (UniqueName: \"kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6\") pod \"c23c141c-3e55-4c42-a52f-845bd8d7104b\" (UID: \"c23c141c-3e55-4c42-a52f-845bd8d7104b\") "
Jul 06 19:12:33.634490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.634395    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume\") pod \"370be469-565b-4fea-aca8-f21771c7df58\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") "
Jul 06 19:12:33.634490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.634415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtsl4\" (UniqueName: \"kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4\") pod \"370be469-565b-4fea-aca8-f21771c7df58\" (UID: \"370be469-565b-4fea-aca8-f21771c7df58\") "
Jul 06 19:12:33.634766 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.634734    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "370be469-565b-4fea-aca8-f21771c7df58" (UID: "370be469-565b-4fea-aca8-f21771c7df58"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:12:33.636409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.636392    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6" (OuterVolumeSpecName: "kube-api-access-n27b6") pod "c23c141c-3e55-4c42-a52f-845bd8d7104b" (UID: "c23c141c-3e55-4c42-a52f-845bd8d7104b"). InnerVolumeSpecName "kube-api-access-n27b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:12:33.636481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.636423    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4" (OuterVolumeSpecName: "kube-api-access-jtsl4") pod "370be469-565b-4fea-aca8-f21771c7df58" (UID: "370be469-565b-4fea-aca8-f21771c7df58"). InnerVolumeSpecName "kube-api-access-jtsl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:12:33.660235 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.660203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:33.668787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.668766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:33.736204 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.736031    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370be469-565b-4fea-aca8-f21771c7df58-extensions-socket-volume\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:12:33.736204 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.736067    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtsl4\" (UniqueName: \"kubernetes.io/projected/370be469-565b-4fea-aca8-f21771c7df58-kube-api-access-jtsl4\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:12:33.736204 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.736086    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n27b6\" (UniqueName: \"kubernetes.io/projected/c23c141c-3e55-4c42-a52f-845bd8d7104b-kube-api-access-n27b6\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:12:33.826954 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.826881    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:33.829384 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:33.829358    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398353e4_cee3_430b_a050_7ed8bdaa7681.slice/crio-d71d366bcd7cdae4dfc25534d2802e6d27350cf064f443f1f8094eda14ab060d WatchSource:0}: Error finding container d71d366bcd7cdae4dfc25534d2802e6d27350cf064f443f1f8094eda14ab060d: Status 404 returned error can't find the container with id d71d366bcd7cdae4dfc25534d2802e6d27350cf064f443f1f8094eda14ab060d
Jul 06 19:12:33.839429 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:12:33.839406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12db7936_1058_46cb_ba97_d3953fa8a5a5.slice/crio-78722d37a46649ea726edd26c15375e70e7566684e61a7cc02369707bda0aa03 WatchSource:0}: Error finding container 78722d37a46649ea726edd26c15375e70e7566684e61a7cc02369707bda0aa03: Status 404 returned error can't find the container with id 78722d37a46649ea726edd26c15375e70e7566684e61a7cc02369707bda0aa03
Jul 06 19:12:33.841205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:33.841182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"]
Jul 06 19:12:34.142869 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.142840    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370be469-565b-4fea-aca8-f21771c7df58" path="/var/lib/kubelet/pods/370be469-565b-4fea-aca8-f21771c7df58/volumes"
Jul 06 19:12:34.143254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.143238    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23c141c-3e55-4c42-a52f-845bd8d7104b" path="/var/lib/kubelet/pods/c23c141c-3e55-4c42-a52f-845bd8d7104b/volumes"
Jul 06 19:12:34.257369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.257335    2559 generic.go:356] "Generic (PLEG): container finished" podID="c23c141c-3e55-4c42-a52f-845bd8d7104b" containerID="9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9" exitCode=0
Jul 06 19:12:34.257776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.257385    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzp9z"
Jul 06 19:12:34.257776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.257459    2559 scope.go:117] "RemoveContainer" containerID="9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9"
Jul 06 19:12:34.259105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.259078    2559 generic.go:356] "Generic (PLEG): container finished" podID="370be469-565b-4fea-aca8-f21771c7df58" containerID="362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0" exitCode=0
Jul 06 19:12:34.259220 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.259136    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pxswz"
Jul 06 19:12:34.261138 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.261108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" event={"ID":"398353e4-cee3-430b-a050-7ed8bdaa7681","Type":"ContainerStarted","Data":"bafa514792189b4865de63181733e011aede1ab2ae652a073d63531a95dbe123"}
Jul 06 19:12:34.261255 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.261180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" event={"ID":"398353e4-cee3-430b-a050-7ed8bdaa7681","Type":"ContainerStarted","Data":"d71d366bcd7cdae4dfc25534d2802e6d27350cf064f443f1f8094eda14ab060d"}
Jul 06 19:12:34.261374 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.261352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:34.262971 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.262948    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw" event={"ID":"12db7936-1058-46cb-ba97-d3953fa8a5a5","Type":"ContainerStarted","Data":"7a34f49733d5e73b758744ada4f8d0c72653d762968b933533a4525f1eba2e2f"}
Jul 06 19:12:34.263062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.263001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw" event={"ID":"12db7936-1058-46cb-ba97-d3953fa8a5a5","Type":"ContainerStarted","Data":"78722d37a46649ea726edd26c15375e70e7566684e61a7cc02369707bda0aa03"}
Jul 06 19:12:34.263062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.263056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:34.269114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.269093    2559 scope.go:117] "RemoveContainer" containerID="9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9"
Jul 06 19:12:34.269515 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:34.269499    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9\": container with ID starting with 9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9 not found: ID does not exist" containerID="9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9"
Jul 06 19:12:34.269580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.269524    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9"} err="failed to get container status \"9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9\": rpc error: code = NotFound desc = could not find container \"9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9\": container with ID starting with 9247cd3e97ab77898065ccf90b326fa458fe3d5b71127b7032947baf7ef8fcf9 not found: ID does not exist"
Jul 06 19:12:34.269580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.269541    2559 scope.go:117] "RemoveContainer" containerID="362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0"
Jul 06 19:12:34.277171 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.277150    2559 scope.go:117] "RemoveContainer" containerID="362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0"
Jul 06 19:12:34.277418 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:12:34.277401    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0\": container with ID starting with 362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0 not found: ID does not exist" containerID="362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0"
Jul 06 19:12:34.277484 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.277430    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0"} err="failed to get container status \"362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0\": rpc error: code = NotFound desc = could not find container \"362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0\": container with ID starting with 362ec556d53a9caba8c737f415119b782a60e369db4cd73d03a692eefd706be0 not found: ID does not exist"
Jul 06 19:12:34.289376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.289334    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" podStartSLOduration=1.289322205 podStartE2EDuration="1.289322205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:34.287199656 +0000 UTC m=+426.719457494" watchObservedRunningTime="2026-07-06 19:12:34.289322205 +0000 UTC m=+426.721580023"
Jul 06 19:12:34.320963 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:34.320766    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw" podStartSLOduration=1.320745463 podStartE2EDuration="1.320745463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:34.319745478 +0000 UTC m=+426.752003301" watchObservedRunningTime="2026-07-06 19:12:34.320745463 +0000 UTC m=+426.753003288"
Jul 06 19:12:36.149038 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:36.149006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:36.367844 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:36.367800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:36.469655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:36.469557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:37.011374 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:37.011327    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:37.112692 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:37.112658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:40.806223 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:40.806190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:40.938123 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:40.938088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:44.587235 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:44.587203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:44.705329 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:44.705282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:45.272067 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:45.272042    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kfmdw"
Jul 06 19:12:45.272320 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:45.272299    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:47.377258 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:47.377228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:47.476879 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:47.476838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:49.297783 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:49.297681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:49.396568 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:49.396530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:12:50.532450 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:50.532415    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:50.532898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:50.532628    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" podUID="398353e4-cee3-430b-a050-7ed8bdaa7681" containerName="manager" containerID="cri-o://bafa514792189b4865de63181733e011aede1ab2ae652a073d63531a95dbe123" gracePeriod=10
Jul 06 19:12:51.354125 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.354098    2559 generic.go:356] "Generic (PLEG): container finished" podID="398353e4-cee3-430b-a050-7ed8bdaa7681" containerID="bafa514792189b4865de63181733e011aede1ab2ae652a073d63531a95dbe123" exitCode=0
Jul 06 19:12:51.354288 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.354167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" event={"ID":"398353e4-cee3-430b-a050-7ed8bdaa7681","Type":"ContainerDied","Data":"bafa514792189b4865de63181733e011aede1ab2ae652a073d63531a95dbe123"}
Jul 06 19:12:51.495218 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.495153    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:51.607043 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.607011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume\") pod \"398353e4-cee3-430b-a050-7ed8bdaa7681\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") "
Jul 06 19:12:51.607538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.607060    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv97k\" (UniqueName: \"kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k\") pod \"398353e4-cee3-430b-a050-7ed8bdaa7681\" (UID: \"398353e4-cee3-430b-a050-7ed8bdaa7681\") "
Jul 06 19:12:51.607538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.607474    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "398353e4-cee3-430b-a050-7ed8bdaa7681" (UID: "398353e4-cee3-430b-a050-7ed8bdaa7681"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:12:51.609121 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.609094    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k" (OuterVolumeSpecName: "kube-api-access-nv97k") pod "398353e4-cee3-430b-a050-7ed8bdaa7681" (UID: "398353e4-cee3-430b-a050-7ed8bdaa7681"). InnerVolumeSpecName "kube-api-access-nv97k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:12:51.708210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.708177    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/398353e4-cee3-430b-a050-7ed8bdaa7681-extensions-socket-volume\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:12:51.708210 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:51.708206    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv97k\" (UniqueName: \"kubernetes.io/projected/398353e4-cee3-430b-a050-7ed8bdaa7681-kube-api-access-nv97k\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:12:52.359994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:52.359961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr" event={"ID":"398353e4-cee3-430b-a050-7ed8bdaa7681","Type":"ContainerDied","Data":"d71d366bcd7cdae4dfc25534d2802e6d27350cf064f443f1f8094eda14ab060d"}
Jul 06 19:12:52.360181 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:52.360025    2559 scope.go:117] "RemoveContainer" containerID="bafa514792189b4865de63181733e011aede1ab2ae652a073d63531a95dbe123"
Jul 06 19:12:52.360181 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:52.360054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"
Jul 06 19:12:52.383725 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:52.383693    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:52.392400 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:52.392371    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whxcr"]
Jul 06 19:12:54.142106 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:12:54.142076    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398353e4-cee3-430b-a050-7ed8bdaa7681" path="/var/lib/kubelet/pods/398353e4-cee3-430b-a050-7ed8bdaa7681/volumes"
Jul 06 19:13:06.997987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:06.997954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"]
Jul 06 19:13:06.998371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:06.998334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398353e4-cee3-430b-a050-7ed8bdaa7681" containerName="manager"
Jul 06 19:13:06.998371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:06.998345    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="398353e4-cee3-430b-a050-7ed8bdaa7681" containerName="manager"
Jul 06 19:13:06.998456 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:06.998414    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="398353e4-cee3-430b-a050-7ed8bdaa7681" containerName="manager"
Jul 06 19:13:07.001599 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.001583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.005052 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.005031    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h4hps\""
Jul 06 19:13:07.018496 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.018469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"]
Jul 06 19:13:07.036146 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7ef99c-b239-43f3-8add-ebc52c057120-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036429 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036429 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036497 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036497 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.036580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.036539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt8th\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-kube-api-access-tt8th\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.037175 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.037149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:07.137241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt8th\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-kube-api-access-tt8th\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7ef99c-b239-43f3-8add-ebc52c057120-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137826 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137826 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137652    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137826 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137754    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.137969 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.137870    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.138096 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.138080    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.138149 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.138132    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7ef99c-b239-43f3-8add-ebc52c057120-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.140197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.140176    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.140323 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.140306    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.151871 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.151848    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt8th\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-kube-api-access-tt8th\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.152519 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.152499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7ef99c-b239-43f3-8add-ebc52c057120-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4k7r\" (UID: \"ea7ef99c-b239-43f3-8add-ebc52c057120\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.166114 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.166093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:07.277685 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.277598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:07.311518 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.311490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:07.447306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.447209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"]
Jul 06 19:13:07.450079 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:07.450052    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7ef99c_b239_43f3_8add_ebc52c057120.slice/crio-e7fdeba5fc97aa1134136da0e0acc676aca2547e78af71c8ae33112853972179 WatchSource:0}: Error finding container e7fdeba5fc97aa1134136da0e0acc676aca2547e78af71c8ae33112853972179: Status 404 returned error can't find the container with id e7fdeba5fc97aa1134136da0e0acc676aca2547e78af71c8ae33112853972179
Jul 06 19:13:07.452129 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.452100    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:13:07.452196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.452163    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:13:07.452196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:07.452191    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:13:08.437780 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:08.437745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" event={"ID":"ea7ef99c-b239-43f3-8add-ebc52c057120","Type":"ContainerStarted","Data":"d820774b1b9d39b29223aa6c380edc3481e6572179c0787380e8b8221c231647"}
Jul 06 19:13:08.438188 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:08.437798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" event={"ID":"ea7ef99c-b239-43f3-8add-ebc52c057120","Type":"ContainerStarted","Data":"e7fdeba5fc97aa1134136da0e0acc676aca2547e78af71c8ae33112853972179"}
Jul 06 19:13:08.471039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:08.470994    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" podStartSLOduration=2.470977881 podStartE2EDuration="2.470977881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:08.46787309 +0000 UTC m=+460.900130916" watchObservedRunningTime="2026-07-06 19:13:08.470977881 +0000 UTC m=+460.903235708"
Jul 06 19:13:09.311968 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:09.311918    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:09.317044 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:09.317015    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:09.443247 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:09.443221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:09.444181 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:09.444164    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:13:11.761749 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.761716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:11.763277 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.763259    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:11.765955 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.765917    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.770273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.770257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zhmjg\""
Jul 06 19:13:11.770382 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.770257    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:13:11.788799 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.788759    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:11.842557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.842526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:11.854962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.854912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:11.879106 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.879080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.879252 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.879128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98vv\" (UniqueName: \"kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.958781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.958739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:11.980072 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.980046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.980223 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.980085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98vv\" (UniqueName: \"kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.980661 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.980643    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:11.991222 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:11.991201    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98vv\" (UniqueName: \"kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv\") pod \"limitador-limitador-64c94fd64f-xwngx\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:12.076436 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.076321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:12.223376 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.223353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:12.225246 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:12.225213    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c107606_6b79_46e1_ba8b_4fba52161d79.slice/crio-b1b4fa69afe42254ee3556ac73a3ab49362a88a844d929ee8adb3a31988d2bce WatchSource:0}: Error finding container b1b4fa69afe42254ee3556ac73a3ab49362a88a844d929ee8adb3a31988d2bce: Status 404 returned error can't find the container with id b1b4fa69afe42254ee3556ac73a3ab49362a88a844d929ee8adb3a31988d2bce
Jul 06 19:13:12.457967 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.457916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" event={"ID":"8c107606-6b79-46e1-ba8b-4fba52161d79","Type":"ContainerStarted","Data":"b1b4fa69afe42254ee3556ac73a3ab49362a88a844d929ee8adb3a31988d2bce"}
Jul 06 19:13:12.571060 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.571021    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:12.574758 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.574736    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:12.578207 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.578187    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mfwsm\""
Jul 06 19:13:12.586253 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.586231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:12.612987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.612951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:12.685630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.685597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qphg9\" (UniqueName: \"kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9\") pod \"authorino-58cd955675-z9flw\" (UID: \"5ee0ce0f-83df-4249-8bec-c1a014721a03\") " pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:12.699375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.699345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:12.786877 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.786790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qphg9\" (UniqueName: \"kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9\") pod \"authorino-58cd955675-z9flw\" (UID: \"5ee0ce0f-83df-4249-8bec-c1a014721a03\") " pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:12.796999 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.796953    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qphg9\" (UniqueName: \"kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9\") pod \"authorino-58cd955675-z9flw\" (UID: \"5ee0ce0f-83df-4249-8bec-c1a014721a03\") " pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:12.884734 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:12.884698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:13.046740 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:13.046709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:13.465825 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:13.465787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9flw" event={"ID":"5ee0ce0f-83df-4249-8bec-c1a014721a03","Type":"ContainerStarted","Data":"9321c3e81b95729179f2c6e4762089c528cf38578fb516641f56750bda6c3e02"}
Jul 06 19:13:15.480754 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:15.480720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" event={"ID":"8c107606-6b79-46e1-ba8b-4fba52161d79","Type":"ContainerStarted","Data":"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"}
Jul 06 19:13:15.481170 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:15.480855    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:15.502283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:15.502233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" podStartSLOduration=1.669875426 podStartE2EDuration="4.502216267s" totalImagesPullingTime="2.832340841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:15.501619655 +0000 UTC m=+467.933877481" watchObservedRunningTime="2026-07-06 19:13:15.502216267 +0000 UTC m=+467.934474091"
Jul 06 19:13:18.412414 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:18.412379    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:18.502001 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:18.501965    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9flw" event={"ID":"5ee0ce0f-83df-4249-8bec-c1a014721a03","Type":"ContainerStarted","Data":"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"}
Jul 06 19:13:18.519862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:18.519810    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z9flw" podStartSLOduration=2.12404556 podStartE2EDuration="6.519794022s" totalImagesPullingTime="4.395748462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:18.518412497 +0000 UTC m=+470.950670320" watchObservedRunningTime="2026-07-06 19:13:18.519794022 +0000 UTC m=+470.952051879"
Jul 06 19:13:19.507142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:19.507102    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z9flw" podUID="5ee0ce0f-83df-4249-8bec-c1a014721a03" containerName="authorino" containerID="cri-o://99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce" gracePeriod=30
Jul 06 19:13:19.749102 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:19.749069    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:19.856296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:19.856215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qphg9\" (UniqueName: \"kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9\") pod \"5ee0ce0f-83df-4249-8bec-c1a014721a03\" (UID: \"5ee0ce0f-83df-4249-8bec-c1a014721a03\") "
Jul 06 19:13:19.858224 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:19.858196    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9" (OuterVolumeSpecName: "kube-api-access-qphg9") pod "5ee0ce0f-83df-4249-8bec-c1a014721a03" (UID: "5ee0ce0f-83df-4249-8bec-c1a014721a03"). InnerVolumeSpecName "kube-api-access-qphg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:19.957722 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:19.957683    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qphg9\" (UniqueName: \"kubernetes.io/projected/5ee0ce0f-83df-4249-8bec-c1a014721a03-kube-api-access-qphg9\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:13:20.513651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.513578    2559 generic.go:356] "Generic (PLEG): container finished" podID="5ee0ce0f-83df-4249-8bec-c1a014721a03" containerID="99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce" exitCode=0
Jul 06 19:13:20.513651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.513613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9flw" event={"ID":"5ee0ce0f-83df-4249-8bec-c1a014721a03","Type":"ContainerDied","Data":"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"}
Jul 06 19:13:20.513651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.513617    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z9flw"
Jul 06 19:13:20.513651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.513639    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z9flw" event={"ID":"5ee0ce0f-83df-4249-8bec-c1a014721a03","Type":"ContainerDied","Data":"9321c3e81b95729179f2c6e4762089c528cf38578fb516641f56750bda6c3e02"}
Jul 06 19:13:20.513651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.513655    2559 scope.go:117] "RemoveContainer" containerID="99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"
Jul 06 19:13:20.522515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.522495    2559 scope.go:117] "RemoveContainer" containerID="99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"
Jul 06 19:13:20.522776 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:13:20.522752    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce\": container with ID starting with 99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce not found: ID does not exist" containerID="99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"
Jul 06 19:13:20.522827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.522775    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce"} err="failed to get container status \"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce\": rpc error: code = NotFound desc = could not find container \"99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce\": container with ID starting with 99460374dd228bb7290f78f030f8dc4e73f3189ce63c57ac3f8b9d5ec5a892ce not found: ID does not exist"
Jul 06 19:13:20.535020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.534998    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:20.538910 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:20.538889    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z9flw"]
Jul 06 19:13:22.144141 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:22.144112    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee0ce0f-83df-4249-8bec-c1a014721a03" path="/var/lib/kubelet/pods/5ee0ce0f-83df-4249-8bec-c1a014721a03/volumes"
Jul 06 19:13:26.488640 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:26.488611    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:27.406773 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:27.406737    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:27.406966 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:27.406943    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" podUID="8c107606-6b79-46e1-ba8b-4fba52161d79" containerName="limitador" containerID="cri-o://dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8" gracePeriod=30
Jul 06 19:13:27.955767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:27.955735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:28.031695 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.031672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file\") pod \"8c107606-6b79-46e1-ba8b-4fba52161d79\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") "
Jul 06 19:13:28.031803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.031770    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p98vv\" (UniqueName: \"kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv\") pod \"8c107606-6b79-46e1-ba8b-4fba52161d79\" (UID: \"8c107606-6b79-46e1-ba8b-4fba52161d79\") "
Jul 06 19:13:28.032009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.031985    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file" (OuterVolumeSpecName: "config-file") pod "8c107606-6b79-46e1-ba8b-4fba52161d79" (UID: "8c107606-6b79-46e1-ba8b-4fba52161d79"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:28.033790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.033769    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv" (OuterVolumeSpecName: "kube-api-access-p98vv") pod "8c107606-6b79-46e1-ba8b-4fba52161d79" (UID: "8c107606-6b79-46e1-ba8b-4fba52161d79"). InnerVolumeSpecName "kube-api-access-p98vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:28.132411 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.132371    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p98vv\" (UniqueName: \"kubernetes.io/projected/8c107606-6b79-46e1-ba8b-4fba52161d79-kube-api-access-p98vv\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:13:28.132411 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.132405    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c107606-6b79-46e1-ba8b-4fba52161d79-config-file\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:13:28.556453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.556412    2559 generic.go:356] "Generic (PLEG): container finished" podID="8c107606-6b79-46e1-ba8b-4fba52161d79" containerID="dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8" exitCode=0
Jul 06 19:13:28.556453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.556458    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx"
Jul 06 19:13:28.556674 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.556492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" event={"ID":"8c107606-6b79-46e1-ba8b-4fba52161d79","Type":"ContainerDied","Data":"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"}
Jul 06 19:13:28.556674 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.556539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xwngx" event={"ID":"8c107606-6b79-46e1-ba8b-4fba52161d79","Type":"ContainerDied","Data":"b1b4fa69afe42254ee3556ac73a3ab49362a88a844d929ee8adb3a31988d2bce"}
Jul 06 19:13:28.556674 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.556564    2559 scope.go:117] "RemoveContainer" containerID="dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"
Jul 06 19:13:28.564886 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.564867    2559 scope.go:117] "RemoveContainer" containerID="dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"
Jul 06 19:13:28.565169 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:13:28.565151    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8\": container with ID starting with dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8 not found: ID does not exist" containerID="dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"
Jul 06 19:13:28.565243 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.565179    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8"} err="failed to get container status \"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8\": rpc error: code = NotFound desc = could not find container \"dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8\": container with ID starting with dd64bd4b3d96f9e9c33b66cf95f2b6f6388a29733648cfc8961fe5dd51457bd8 not found: ID does not exist"
Jul 06 19:13:28.573230 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.573200    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:28.574893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:28.574876    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xwngx"]
Jul 06 19:13:30.141811 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:30.141777    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c107606-6b79-46e1-ba8b-4fba52161d79" path="/var/lib/kubelet/pods/8c107606-6b79-46e1-ba8b-4fba52161d79/volumes"
Jul 06 19:13:31.353174 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353144    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-v765f"]
Jul 06 19:13:31.353736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353717    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee0ce0f-83df-4249-8bec-c1a014721a03" containerName="authorino"
Jul 06 19:13:31.353829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353738    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee0ce0f-83df-4249-8bec-c1a014721a03" containerName="authorino"
Jul 06 19:13:31.353829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353759    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c107606-6b79-46e1-ba8b-4fba52161d79" containerName="limitador"
Jul 06 19:13:31.353829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353767    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c107606-6b79-46e1-ba8b-4fba52161d79" containerName="limitador"
Jul 06 19:13:31.354003 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353861    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee0ce0f-83df-4249-8bec-c1a014721a03" containerName="authorino"
Jul 06 19:13:31.354003 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.353881    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c107606-6b79-46e1-ba8b-4fba52161d79" containerName="limitador"
Jul 06 19:13:31.357299 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.357273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.360212 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.360191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 19:13:31.360334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.360196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fsr44\""
Jul 06 19:13:31.365348 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.365016    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-v765f"]
Jul 06 19:13:31.386231 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.386194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:31.463124 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.463090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/497a279c-2634-4b79-ad52-94153cf128ff-data\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.463290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.463163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgck8\" (UniqueName: \"kubernetes.io/projected/497a279c-2634-4b79-ad52-94153cf128ff-kube-api-access-kgck8\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.564305 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.564272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/497a279c-2634-4b79-ad52-94153cf128ff-data\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.564467 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.564350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgck8\" (UniqueName: \"kubernetes.io/projected/497a279c-2634-4b79-ad52-94153cf128ff-kube-api-access-kgck8\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.564715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.564696    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/497a279c-2634-4b79-ad52-94153cf128ff-data\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.573301 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.573280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgck8\" (UniqueName: \"kubernetes.io/projected/497a279c-2634-4b79-ad52-94153cf128ff-kube-api-access-kgck8\") pod \"postgres-69fb4594cf-v765f\" (UID: \"497a279c-2634-4b79-ad52-94153cf128ff\") " pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.669433 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.669401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:31.802659 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:31.802630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-v765f"]
Jul 06 19:13:31.804242 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:31.804220    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497a279c_2634_4b79_ad52_94153cf128ff.slice/crio-963e5395444ba902509f29961abc75da112aff001cc3000e6c31cd3fa7535cee WatchSource:0}: Error finding container 963e5395444ba902509f29961abc75da112aff001cc3000e6c31cd3fa7535cee: Status 404 returned error can't find the container with id 963e5395444ba902509f29961abc75da112aff001cc3000e6c31cd3fa7535cee
Jul 06 19:13:32.580671 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:32.580636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-v765f" event={"ID":"497a279c-2634-4b79-ad52-94153cf128ff","Type":"ContainerStarted","Data":"963e5395444ba902509f29961abc75da112aff001cc3000e6c31cd3fa7535cee"}
Jul 06 19:13:37.611296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:37.611219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-v765f" event={"ID":"497a279c-2634-4b79-ad52-94153cf128ff","Type":"ContainerStarted","Data":"3bd59e2e44255f58aa863f1d0f32c4b8d3eb7cdbcbf0e02e275ab1a431bcf5b1"}
Jul 06 19:13:37.611706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:37.611335    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:37.629627 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:37.629585    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-v765f" podStartSLOduration=1.3192260230000001 podStartE2EDuration="6.629570828s" totalImagesPullingTime="5.310344805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:37.628805681 +0000 UTC m=+490.061063523" watchObservedRunningTime="2026-07-06 19:13:37.629570828 +0000 UTC m=+490.061828651"
Jul 06 19:13:43.645441 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:43.645414    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-v765f"
Jul 06 19:13:43.989615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:43.989525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:44.236827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.236794    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:44.245990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.245885    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:44.246439 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.246421    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:44.248806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.248785    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mfwsm\""
Jul 06 19:13:44.284506 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.284467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbjq4\" (UniqueName: \"kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4\") pod \"authorino-5d4b67c446-gqn7k\" (UID: \"9ed29e0d-2988-4364-8f93-894c568668be\") " pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:44.385308 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.385276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbjq4\" (UniqueName: \"kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4\") pod \"authorino-5d4b67c446-gqn7k\" (UID: \"9ed29e0d-2988-4364-8f93-894c568668be\") " pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:44.393859 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.393825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbjq4\" (UniqueName: \"kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4\") pod \"authorino-5d4b67c446-gqn7k\" (UID: \"9ed29e0d-2988-4364-8f93-894c568668be\") " pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:44.492616 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.492577    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:44.492873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.492856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:44.519591 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.519311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:44.532269 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.532243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:44.532387 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.532334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:44.626480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.626451    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:44.654637 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.654613    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:44.656812 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:44.656783    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ed29e0d_2988_4364_8f93_894c568668be.slice/crio-34b31afb6cdcb45f218e236772cac06eab90c29f7b5757e79d78c647db509340 WatchSource:0}: Error finding container 34b31afb6cdcb45f218e236772cac06eab90c29f7b5757e79d78c647db509340: Status 404 returned error can't find the container with id 34b31afb6cdcb45f218e236772cac06eab90c29f7b5757e79d78c647db509340
Jul 06 19:13:44.688866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.688838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6zz2\" (UniqueName: \"kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2\") pod \"authorino-5544c46c5b-nxkrn\" (UID: \"b1f8e566-8535-4ad7-a9fc-04ce941c560a\") " pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:44.789340 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.789260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6zz2\" (UniqueName: \"kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2\") pod \"authorino-5544c46c5b-nxkrn\" (UID: \"b1f8e566-8535-4ad7-a9fc-04ce941c560a\") " pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:44.797821 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.797797    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6zz2\" (UniqueName: \"kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2\") pod \"authorino-5544c46c5b-nxkrn\" (UID: \"b1f8e566-8535-4ad7-a9fc-04ce941c560a\") " pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:44.851670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.851641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:44.881401 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.881371    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:44.911377 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.911345    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:13:44.937835 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.937798    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:13:44.938013 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.937894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:44.941537 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.940791    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:13:44.991803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.991765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:44.991988 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:44.991884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrsl\" (UniqueName: \"kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.024187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.024164    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:45.025996 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:45.025967    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1f8e566_8535_4ad7_a9fc_04ce941c560a.slice/crio-1bb1f31d5227c6525d2c6bc7c956f304b529162991fa88d8b7ad8286816f7b10 WatchSource:0}: Error finding container 1bb1f31d5227c6525d2c6bc7c956f304b529162991fa88d8b7ad8286816f7b10: Status 404 returned error can't find the container with id 1bb1f31d5227c6525d2c6bc7c956f304b529162991fa88d8b7ad8286816f7b10
Jul 06 19:13:45.092579 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.092510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.092722 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.092587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrsl\" (UniqueName: \"kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.094887 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.094866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.101768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.101742    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrsl\" (UniqueName: \"kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl\") pod \"authorino-68b547cdd8-dhg5d\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") " pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.252860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.252823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:13:45.408623 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.408591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:13:45.417844 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:45.417816    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff9b4399_2cfc_4b14_bbd2_04ca352f406c.slice/crio-12018f0b0214fa1726ed13e8090e163f74e6855bd168711c4baa6fe46cbe05a8 WatchSource:0}: Error finding container 12018f0b0214fa1726ed13e8090e163f74e6855bd168711c4baa6fe46cbe05a8: Status 404 returned error can't find the container with id 12018f0b0214fa1726ed13e8090e163f74e6855bd168711c4baa6fe46cbe05a8
Jul 06 19:13:45.651231 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.651197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" event={"ID":"b1f8e566-8535-4ad7-a9fc-04ce941c560a","Type":"ContainerStarted","Data":"1bb1f31d5227c6525d2c6bc7c956f304b529162991fa88d8b7ad8286816f7b10"}
Jul 06 19:13:45.652723 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.652693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" event={"ID":"9ed29e0d-2988-4364-8f93-894c568668be","Type":"ContainerStarted","Data":"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"}
Jul 06 19:13:45.652863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.652698    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" podUID="9ed29e0d-2988-4364-8f93-894c568668be" containerName="authorino" containerID="cri-o://d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183" gracePeriod=30
Jul 06 19:13:45.652863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.652734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" event={"ID":"9ed29e0d-2988-4364-8f93-894c568668be","Type":"ContainerStarted","Data":"34b31afb6cdcb45f218e236772cac06eab90c29f7b5757e79d78c647db509340"}
Jul 06 19:13:45.653962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.653913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" event={"ID":"ff9b4399-2cfc-4b14-bbd2-04ca352f406c","Type":"ContainerStarted","Data":"12018f0b0214fa1726ed13e8090e163f74e6855bd168711c4baa6fe46cbe05a8"}
Jul 06 19:13:45.668460 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.668420    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" podStartSLOduration=0.962211037 podStartE2EDuration="1.668405374s" totalImagesPullingTime="706.194337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:45.667371239 +0000 UTC m=+498.099629065" watchObservedRunningTime="2026-07-06 19:13:45.668405374 +0000 UTC m=+498.100663198"
Jul 06 19:13:45.955705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:45.955684    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:46.001639 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.001608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbjq4\" (UniqueName: \"kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4\") pod \"9ed29e0d-2988-4364-8f93-894c568668be\" (UID: \"9ed29e0d-2988-4364-8f93-894c568668be\") "
Jul 06 19:13:46.003480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.003453    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4" (OuterVolumeSpecName: "kube-api-access-lbjq4") pod "9ed29e0d-2988-4364-8f93-894c568668be" (UID: "9ed29e0d-2988-4364-8f93-894c568668be"). InnerVolumeSpecName "kube-api-access-lbjq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:46.103099 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.103076    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbjq4\" (UniqueName: \"kubernetes.io/projected/9ed29e0d-2988-4364-8f93-894c568668be-kube-api-access-lbjq4\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:13:46.661171 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.661136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" event={"ID":"b1f8e566-8535-4ad7-a9fc-04ce941c560a","Type":"ContainerStarted","Data":"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"}
Jul 06 19:13:46.661350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.661177    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" podUID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" containerName="authorino" containerID="cri-o://a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847" gracePeriod=30
Jul 06 19:13:46.662554 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.662534    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ed29e0d-2988-4364-8f93-894c568668be" containerID="d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183" exitCode=0
Jul 06 19:13:46.662689 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.662572    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gqn7k"
Jul 06 19:13:46.662689 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.662619    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" event={"ID":"9ed29e0d-2988-4364-8f93-894c568668be","Type":"ContainerDied","Data":"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"}
Jul 06 19:13:46.662689 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.662661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gqn7k" event={"ID":"9ed29e0d-2988-4364-8f93-894c568668be","Type":"ContainerDied","Data":"34b31afb6cdcb45f218e236772cac06eab90c29f7b5757e79d78c647db509340"}
Jul 06 19:13:46.662833 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.662681    2559 scope.go:117] "RemoveContainer" containerID="d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"
Jul 06 19:13:46.664665 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.664642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" event={"ID":"ff9b4399-2cfc-4b14-bbd2-04ca352f406c","Type":"ContainerStarted","Data":"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"}
Jul 06 19:13:46.671723 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.671703    2559 scope.go:117] "RemoveContainer" containerID="d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"
Jul 06 19:13:46.672020 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:13:46.672001    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183\": container with ID starting with d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183 not found: ID does not exist" containerID="d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"
Jul 06 19:13:46.672070 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.672028    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183"} err="failed to get container status \"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183\": rpc error: code = NotFound desc = could not find container \"d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183\": container with ID starting with d639ef88ad71aefafa63558719c68ae098c75648d57daf3657786688f6a4b183 not found: ID does not exist"
Jul 06 19:13:46.676607 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.676566    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" podStartSLOduration=1.611044937 podStartE2EDuration="2.676554848s" totalImagesPullingTime="1.065509911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:46.676139247 +0000 UTC m=+499.108397085" watchObservedRunningTime="2026-07-06 19:13:46.676554848 +0000 UTC m=+499.108812671"
Jul 06 19:13:46.691954 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.691918    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:46.695013 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.694994    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gqn7k"]
Jul 06 19:13:46.709222 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.709178    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" podStartSLOduration=2.225782218 podStartE2EDuration="2.709164847s" totalImagesPullingTime="483.382629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:46.707153391 +0000 UTC m=+499.139411217" watchObservedRunningTime="2026-07-06 19:13:46.709164847 +0000 UTC m=+499.141422670"
Jul 06 19:13:46.979664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:46.979632    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:47.010955 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.010906    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6zz2\" (UniqueName: \"kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2\") pod \"b1f8e566-8535-4ad7-a9fc-04ce941c560a\" (UID: \"b1f8e566-8535-4ad7-a9fc-04ce941c560a\") "
Jul 06 19:13:47.012994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.012960    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2" (OuterVolumeSpecName: "kube-api-access-r6zz2") pod "b1f8e566-8535-4ad7-a9fc-04ce941c560a" (UID: "b1f8e566-8535-4ad7-a9fc-04ce941c560a"). InnerVolumeSpecName "kube-api-access-r6zz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:47.111941 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.111905    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6zz2\" (UniqueName: \"kubernetes.io/projected/b1f8e566-8535-4ad7-a9fc-04ce941c560a-kube-api-access-r6zz2\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:13:47.670860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.670827    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" containerID="a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847" exitCode=0
Jul 06 19:13:47.671077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.670866    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5544c46c5b-nxkrn"
Jul 06 19:13:47.671077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.670895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" event={"ID":"b1f8e566-8535-4ad7-a9fc-04ce941c560a","Type":"ContainerDied","Data":"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"}
Jul 06 19:13:47.671077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.670956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5544c46c5b-nxkrn" event={"ID":"b1f8e566-8535-4ad7-a9fc-04ce941c560a","Type":"ContainerDied","Data":"1bb1f31d5227c6525d2c6bc7c956f304b529162991fa88d8b7ad8286816f7b10"}
Jul 06 19:13:47.671077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.670978    2559 scope.go:117] "RemoveContainer" containerID="a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"
Jul 06 19:13:47.679964 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.679865    2559 scope.go:117] "RemoveContainer" containerID="a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"
Jul 06 19:13:47.680290 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:13:47.680274    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847\": container with ID starting with a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847 not found: ID does not exist" containerID="a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"
Jul 06 19:13:47.680349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.680299    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847"} err="failed to get container status \"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847\": rpc error: code = NotFound desc = could not find container \"a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847\": container with ID starting with a62365dd01316c71f99a730b8711051dba944f8999400416af5ec347a2c47847 not found: ID does not exist"
Jul 06 19:13:47.693064 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.693034    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:47.696555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:47.696533    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5544c46c5b-nxkrn"]
Jul 06 19:13:48.143808 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:48.143777    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed29e0d-2988-4364-8f93-894c568668be" path="/var/lib/kubelet/pods/9ed29e0d-2988-4364-8f93-894c568668be/volumes"
Jul 06 19:13:48.144244 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:48.144224    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" path="/var/lib/kubelet/pods/b1f8e566-8535-4ad7-a9fc-04ce941c560a/volumes"
Jul 06 19:13:51.337474 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.337440    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:51.340306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340278    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:13:51.340782 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340766    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" containerName="authorino"
Jul 06 19:13:51.340863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340784    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" containerName="authorino"
Jul 06 19:13:51.340863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340797    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed29e0d-2988-4364-8f93-894c568668be" containerName="authorino"
Jul 06 19:13:51.340863 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340802    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed29e0d-2988-4364-8f93-894c568668be" containerName="authorino"
Jul 06 19:13:51.340982 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340886    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f8e566-8535-4ad7-a9fc-04ce941c560a" containerName="authorino"
Jul 06 19:13:51.340982 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.340896    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ed29e0d-2988-4364-8f93-894c568668be" containerName="authorino"
Jul 06 19:13:51.343251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.343236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.346732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.346709    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:13:51.346860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.346799    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-55bdk\""
Jul 06 19:13:51.346993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.346975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:13:51.357842 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.357821    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:13:51.440352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.440313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:51.451156 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.451127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxvx\" (UniqueName: \"kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.451315 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.451182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.451315 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.451229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.529062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.529028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:13:51.531699 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.531683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.541553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.541527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:13:51.552824 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.552780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.552824 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.552820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwcc\" (UniqueName: \"kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.553042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.552870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.553042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.552961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.553042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.553003    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxvx\" (UniqueName: \"kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.553042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.553028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.553885 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.553865    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.555295 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.555278    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.564245 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.564226    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxvx\" (UniqueName: \"kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx\") pod \"maas-controller-5858696bd8-qfd5k\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") " pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.653366 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.653327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:51.653585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.653562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.653670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.653652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwcc\" (UniqueName: \"kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.653796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.653764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.654386 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.654364    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.655902 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.655885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.662702 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.662681    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwcc\" (UniqueName: \"kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc\") pod \"maas-controller-6fcff6bdb8-h892h\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") " pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.745530 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.745495    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:51.790209 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.790177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:13:51.791491 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:51.791467    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0868529a_fe3a_469e_b862_09147a024944.slice/crio-b6598feba076b79e12680544aea0290611d558d4fc1adf202f6d057113c5d670 WatchSource:0}: Error finding container b6598feba076b79e12680544aea0290611d558d4fc1adf202f6d057113c5d670: Status 404 returned error can't find the container with id b6598feba076b79e12680544aea0290611d558d4fc1adf202f6d057113c5d670
Jul 06 19:13:51.842866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.842841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:51.971045 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:51.971020    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:13:51.972684 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:13:51.972659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e494d8_5d73_4d9c_b41b_970219ad4dd6.slice/crio-e554ff738ff057c1b03df14a27437fdeb3e09644ac057f0769320c82306b43c0 WatchSource:0}: Error finding container e554ff738ff057c1b03df14a27437fdeb3e09644ac057f0769320c82306b43c0: Status 404 returned error can't find the container with id e554ff738ff057c1b03df14a27437fdeb3e09644ac057f0769320c82306b43c0
Jul 06 19:13:52.703514 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:52.703473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" event={"ID":"69e494d8-5d73-4d9c-b41b-970219ad4dd6","Type":"ContainerStarted","Data":"e554ff738ff057c1b03df14a27437fdeb3e09644ac057f0769320c82306b43c0"}
Jul 06 19:13:52.705153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:52.705123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5858696bd8-qfd5k" event={"ID":"0868529a-fe3a-469e-b862-09147a024944","Type":"ContainerStarted","Data":"b6598feba076b79e12680544aea0290611d558d4fc1adf202f6d057113c5d670"}
Jul 06 19:13:54.718909 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.718864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" event={"ID":"69e494d8-5d73-4d9c-b41b-970219ad4dd6","Type":"ContainerStarted","Data":"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"}
Jul 06 19:13:54.719351 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.719052    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:13:54.720434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.720414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5858696bd8-qfd5k" event={"ID":"0868529a-fe3a-469e-b862-09147a024944","Type":"ContainerStarted","Data":"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"}
Jul 06 19:13:54.720555 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.720543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:13:54.743952 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.743892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:54.762082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.761987    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" podStartSLOduration=1.222176881 podStartE2EDuration="3.761967509s" totalImagesPullingTime="2.539790628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:54.760127545 +0000 UTC m=+507.192385400" watchObservedRunningTime="2026-07-06 19:13:54.761967509 +0000 UTC m=+507.194225366"
Jul 06 19:13:54.803836 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.803785    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5858696bd8-qfd5k" podStartSLOduration=1.0872767190000001 podStartE2EDuration="3.803769303s" totalImagesPullingTime="2.716492584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:54.803369023 +0000 UTC m=+507.235626848" watchObservedRunningTime="2026-07-06 19:13:54.803769303 +0000 UTC m=+507.236027126"
Jul 06 19:13:54.918419 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:54.918388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:13:55.569764 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:13:55.569703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:05.730698 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:05.730667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:14:05.731080 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:05.730776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:14:05.793907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:05.793874    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:14:05.794120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:05.794084    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5858696bd8-qfd5k" podUID="0868529a-fe3a-469e-b862-09147a024944" containerName="manager" containerID="cri-o://22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c" gracePeriod=30
Jul 06 19:14:06.047767 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.047742    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:14:06.197559 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.197527    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvxvx\" (UniqueName: \"kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx\") pod \"0868529a-fe3a-469e-b862-09147a024944\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") "
Jul 06 19:14:06.197745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.197618    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca\") pod \"0868529a-fe3a-469e-b862-09147a024944\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") "
Jul 06 19:14:06.197745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.197688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert\") pod \"0868529a-fe3a-469e-b862-09147a024944\" (UID: \"0868529a-fe3a-469e-b862-09147a024944\") "
Jul 06 19:14:06.197996 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.197975    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca" (OuterVolumeSpecName: "service-ca") pod "0868529a-fe3a-469e-b862-09147a024944" (UID: "0868529a-fe3a-469e-b862-09147a024944"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:14:06.199790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.199768    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0868529a-fe3a-469e-b862-09147a024944" (UID: "0868529a-fe3a-469e-b862-09147a024944"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:14:06.199901 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.199787    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx" (OuterVolumeSpecName: "kube-api-access-dvxvx") pod "0868529a-fe3a-469e-b862-09147a024944" (UID: "0868529a-fe3a-469e-b862-09147a024944"). InnerVolumeSpecName "kube-api-access-dvxvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:14:06.299142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.299063    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0868529a-fe3a-469e-b862-09147a024944-webhook-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:14:06.299142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.299091    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvxvx\" (UniqueName: \"kubernetes.io/projected/0868529a-fe3a-469e-b862-09147a024944-kube-api-access-dvxvx\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:14:06.299142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.299103    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0868529a-fe3a-469e-b862-09147a024944-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:14:06.782246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.782210    2559 generic.go:356] "Generic (PLEG): container finished" podID="0868529a-fe3a-469e-b862-09147a024944" containerID="22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c" exitCode=0
Jul 06 19:14:06.782663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.782260    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5858696bd8-qfd5k"
Jul 06 19:14:06.782663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.782297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5858696bd8-qfd5k" event={"ID":"0868529a-fe3a-469e-b862-09147a024944","Type":"ContainerDied","Data":"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"}
Jul 06 19:14:06.782663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.782354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5858696bd8-qfd5k" event={"ID":"0868529a-fe3a-469e-b862-09147a024944","Type":"ContainerDied","Data":"b6598feba076b79e12680544aea0290611d558d4fc1adf202f6d057113c5d670"}
Jul 06 19:14:06.782663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.782378    2559 scope.go:117] "RemoveContainer" containerID="22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"
Jul 06 19:14:06.791333 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.791316    2559 scope.go:117] "RemoveContainer" containerID="22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"
Jul 06 19:14:06.791599 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:14:06.791580    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c\": container with ID starting with 22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c not found: ID does not exist" containerID="22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"
Jul 06 19:14:06.791667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.791607    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c"} err="failed to get container status \"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c\": rpc error: code = NotFound desc = could not find container \"22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c\": container with ID starting with 22eb6991238fa7ac9fd061d7243638bffe4daec283c03160b9acf1e4ab46f43c not found: ID does not exist"
Jul 06 19:14:06.803522 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.803500    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:14:06.805410 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:06.805393    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5858696bd8-qfd5k"]
Jul 06 19:14:08.141790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:08.141755    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0868529a-fe3a-469e-b862-09147a024944" path="/var/lib/kubelet/pods/0868529a-fe3a-469e-b862-09147a024944/volumes"
Jul 06 19:14:16.015273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:16.015236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:25.134536 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.134438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:25.534475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.534395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:25.595728 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.595693    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-86db469997-5zlwj"]
Jul 06 19:14:25.596150 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.596136    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0868529a-fe3a-469e-b862-09147a024944" containerName="manager"
Jul 06 19:14:25.596217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.596159    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0868529a-fe3a-469e-b862-09147a024944" containerName="manager"
Jul 06 19:14:25.596258 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.596216    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0868529a-fe3a-469e-b862-09147a024944" containerName="manager"
Jul 06 19:14:25.601289 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.601269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.604317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.604280    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 19:14:25.604317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.604312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bshpk\""
Jul 06 19:14:25.610426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.610402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86db469997-5zlwj"]
Jul 06 19:14:25.683492 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.683453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45c146f-6baf-480c-aef4-729ae8a3da25-openshift-service-ca\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.683672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.683502    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.683672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.683551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vwrh\" (UniqueName: \"kubernetes.io/projected/d45c146f-6baf-480c-aef4-729ae8a3da25-kube-api-access-4vwrh\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.784781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.784667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45c146f-6baf-480c-aef4-729ae8a3da25-openshift-service-ca\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.784781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.784702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.784781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.784719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vwrh\" (UniqueName: \"kubernetes.io/projected/d45c146f-6baf-480c-aef4-729ae8a3da25-kube-api-access-4vwrh\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.785201 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:14:25.784833    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 19:14:25.785201 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:14:25.784908    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls podName:d45c146f-6baf-480c-aef4-729ae8a3da25 nodeName:}" failed. No retries permitted until 2026-07-06 19:14:26.284889119 +0000 UTC m=+538.717146926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls") pod "maas-api-86db469997-5zlwj" (UID: "d45c146f-6baf-480c-aef4-729ae8a3da25") : secret "maas-api-serving-cert" not found
Jul 06 19:14:25.785630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.785581    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d45c146f-6baf-480c-aef4-729ae8a3da25-openshift-service-ca\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.794540 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.794509    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vwrh\" (UniqueName: \"kubernetes.io/projected/d45c146f-6baf-480c-aef4-729ae8a3da25-kube-api-access-4vwrh\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:25.837848 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.837814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:25.952284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:25.952154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:26.050406 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.050301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:26.057825 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.057796    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85wvp"]
Jul 06 19:14:26.092760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.092724    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85wvp"]
Jul 06 19:14:26.092919 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.092821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.095830 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.095801    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vw4tq\""
Jul 06 19:14:26.095830 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.095805    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 19:14:26.104893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.104866    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cj9rx"]
Jul 06 19:14:26.126195 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.126167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cj9rx"]
Jul 06 19:14:26.126360 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.126275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.188855 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.188818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4nkn\" (UniqueName: \"kubernetes.io/projected/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-kube-api-access-q4nkn\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.189254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.188882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p66h\" (UniqueName: \"kubernetes.io/projected/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-kube-api-access-7p66h\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.189254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.188938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-plugins-config-volume\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.189254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.189012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.290071 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4nkn\" (UniqueName: \"kubernetes.io/projected/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-kube-api-access-q4nkn\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.290249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p66h\" (UniqueName: \"kubernetes.io/projected/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-kube-api-access-7p66h\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.290249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-plugins-config-volume\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.290249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:26.290249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.290819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290795    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.290959 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.290840    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-plugins-config-volume\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.292468 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.292447    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d45c146f-6baf-480c-aef4-729ae8a3da25-maas-api-tls\") pod \"maas-api-86db469997-5zlwj\" (UID: \"d45c146f-6baf-480c-aef4-729ae8a3da25\") " pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:26.298803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.298780    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4nkn\" (UniqueName: \"kubernetes.io/projected/8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb-kube-api-access-q4nkn\") pod \"payload-pre-processing-7964457696-85wvp\" (UID: \"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb\") " pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.298888 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.298823    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p66h\" (UniqueName: \"kubernetes.io/projected/5b9cb0c6-a3e1-4da6-943c-a30d21a7978d-kube-api-access-7p66h\") pod \"payload-processing-58f86c7798-cj9rx\" (UID: \"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d\") " pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.405082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.405054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:26.436788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.436754    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:26.512962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.512596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:26.592375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.592015    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-85wvp"]
Jul 06 19:14:26.595555 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:14:26.595507    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2142d5_3f98_4ebb_9f56_3f670bb3b8fb.slice/crio-4497dae3701c6975aebc6db0f9068d3bb4e38b415084af797f4687ed60ff0bc8 WatchSource:0}: Error finding container 4497dae3701c6975aebc6db0f9068d3bb4e38b415084af797f4687ed60ff0bc8: Status 404 returned error can't find the container with id 4497dae3701c6975aebc6db0f9068d3bb4e38b415084af797f4687ed60ff0bc8
Jul 06 19:14:26.643423 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.642268    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cj9rx"]
Jul 06 19:14:26.729059 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.729027    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-86db469997-5zlwj"]
Jul 06 19:14:26.731038 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:14:26.731007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45c146f_6baf_480c_aef4_729ae8a3da25.slice/crio-06704710cc439e8857ae2740cdda469f76b1a3a470202d9ffc55f56dcf1c5580 WatchSource:0}: Error finding container 06704710cc439e8857ae2740cdda469f76b1a3a470202d9ffc55f56dcf1c5580: Status 404 returned error can't find the container with id 06704710cc439e8857ae2740cdda469f76b1a3a470202d9ffc55f56dcf1c5580
Jul 06 19:14:26.893938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.893876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx" event={"ID":"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d","Type":"ContainerStarted","Data":"d0ddb3eb386a73bd32e2e50f52847f540dbe0976c337fb40357967ca168c8dbe"}
Jul 06 19:14:26.895134 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.895111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp" event={"ID":"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb","Type":"ContainerStarted","Data":"4497dae3701c6975aebc6db0f9068d3bb4e38b415084af797f4687ed60ff0bc8"}
Jul 06 19:14:26.896155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:26.896127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86db469997-5zlwj" event={"ID":"d45c146f-6baf-480c-aef4-729ae8a3da25","Type":"ContainerStarted","Data":"06704710cc439e8857ae2740cdda469f76b1a3a470202d9ffc55f56dcf1c5580"}
Jul 06 19:14:28.909787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.909706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx" event={"ID":"5b9cb0c6-a3e1-4da6-943c-a30d21a7978d","Type":"ContainerStarted","Data":"ad88f7026374c7e3baae8fdc719f3ffc546dd5024a6d1b517e994147e62d0b3d"}
Jul 06 19:14:28.910458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.909848    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:28.911748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.911722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp" event={"ID":"8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb","Type":"ContainerStarted","Data":"e8dc37dcf6a90baa3c4446dd71a0af223eb15cbc688ee6e22e7d272854739d42"}
Jul 06 19:14:28.911877 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.911821    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:28.927554 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.927489    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx" podStartSLOduration=1.355569236 podStartE2EDuration="2.927470023s" totalImagesPullingTime="1.571900787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:28.926816658 +0000 UTC m=+541.359074493" watchObservedRunningTime="2026-07-06 19:14:28.927470023 +0000 UTC m=+541.359727827"
Jul 06 19:14:28.950951 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:28.943282    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp" podStartSLOduration=1.3215063470000001 podStartE2EDuration="2.943261091s" totalImagesPullingTime="1.621754744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:28.942426422 +0000 UTC m=+541.374684265" watchObservedRunningTime="2026-07-06 19:14:28.943261091 +0000 UTC m=+541.375518900"
Jul 06 19:14:29.918993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:29.918960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-86db469997-5zlwj" event={"ID":"d45c146f-6baf-480c-aef4-729ae8a3da25","Type":"ContainerStarted","Data":"9d606b245e2fa2e816069a9747f347276441d463bd090d4868147f4f4a0dcd07"}
Jul 06 19:14:29.919399 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:29.919146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:29.939417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:29.939353    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-86db469997-5zlwj" podStartSLOduration=1.87413701 podStartE2EDuration="4.939331342s" totalImagesPullingTime="3.065194332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:29.93712893 +0000 UTC m=+542.369386774" watchObservedRunningTime="2026-07-06 19:14:29.939331342 +0000 UTC m=+542.371589169"
Jul 06 19:14:33.943395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.943363    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea7ef99c-b239-43f3-8add-ebc52c057120" containerID="d820774b1b9d39b29223aa6c380edc3481e6572179c0787380e8b8221c231647" exitCode=0
Jul 06 19:14:33.943817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.943435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" event={"ID":"ea7ef99c-b239-43f3-8add-ebc52c057120","Type":"ContainerDied","Data":"d820774b1b9d39b29223aa6c380edc3481e6572179c0787380e8b8221c231647"}
Jul 06 19:14:33.943817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.943814    2559 scope.go:117] "RemoveContainer" containerID="d820774b1b9d39b29223aa6c380edc3481e6572179c0787380e8b8221c231647"
Jul 06 19:14:33.944809 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.944782    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:14:33.944911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.944852    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:14:33.944911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:33.944885    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:14:34.953297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:34.953256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" event={"ID":"ea7ef99c-b239-43f3-8add-ebc52c057120","Type":"ContainerStarted","Data":"5c47541bb05adf75241f2ba8a347e46c1d790bd2848d724eae7299478f1b7642"}
Jul 06 19:14:35.311888 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:35.311807    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:14:35.312984 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:35.312958    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4k7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:14:35.313104 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:35.313005    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" podUID="ea7ef99c-b239-43f3-8add-ebc52c057120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 06 19:14:35.930611 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:35.930576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-86db469997-5zlwj"
Jul 06 19:14:36.312994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:36.312872    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4k7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:14:36.312994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:36.312956    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" podUID="ea7ef99c-b239-43f3-8add-ebc52c057120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 06 19:14:37.006267 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:37.006235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:37.096549 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:37.096514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:37.312317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:37.312230    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4k7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:14:37.312317 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:37.312284    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" podUID="ea7ef99c-b239-43f3-8add-ebc52c057120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 06 19:14:38.312134 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:38.312089    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4k7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:14:38.312561 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:38.312171    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r" podUID="ea7ef99c-b239-43f3-8add-ebc52c057120" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 06 19:14:39.316528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:39.316498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:14:39.316910 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:39.316841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:14:39.317626 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:39.317608    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4k7r"
Jul 06 19:14:39.921123 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:39.921075    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp" podUID="8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.48:9004: connect: connection refused"
Jul 06 19:14:39.921373 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:39.921356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-cj9rx"
Jul 06 19:14:43.200364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.200334    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"]
Jul 06 19:14:43.203070 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.203052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.207458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.207436    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:14:43.207604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.207495    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:14:43.207604 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.207571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:14:43.207791 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.207775    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lqm7w\""
Jul 06 19:14:43.219369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.216865    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"]
Jul 06 19:14:43.225199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.225172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:43.262111 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrk9\" (UniqueName: \"kubernetes.io/projected/937d06ab-1b50-4101-a978-2e7763ba1dcf-kube-api-access-rcrk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.262242 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.262284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.262284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.262395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d06ab-1b50-4101-a978-2e7763ba1dcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.262395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.262325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.363109 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.363073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrk9\" (UniqueName: \"kubernetes.io/projected/937d06ab-1b50-4101-a978-2e7763ba1dcf-kube-api-access-rcrk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.363307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.363169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.363307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.363226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.363307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.363251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.363824 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.363795    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.364132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.364079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d06ab-1b50-4101-a978-2e7763ba1dcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.364341 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.364311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.364472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.364159    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.364649 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.364616    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.365906 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.365879    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/937d06ab-1b50-4101-a978-2e7763ba1dcf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.366809 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.366786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d06ab-1b50-4101-a978-2e7763ba1dcf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.372633 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.372606    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrk9\" (UniqueName: \"kubernetes.io/projected/937d06ab-1b50-4101-a978-2e7763ba1dcf-kube-api-access-rcrk9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4\" (UID: \"937d06ab-1b50-4101-a978-2e7763ba1dcf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.515219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.515144    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:43.665453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.665385    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"]
Jul 06 19:14:43.709828 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.709790    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:43.804254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:43.804156    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:14:44.008313 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:44.008273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4" event={"ID":"937d06ab-1b50-4101-a978-2e7763ba1dcf","Type":"ContainerStarted","Data":"38873728ae0e86bdd980550481ca0ac33242558f6433e3aa19a681363ba7afe4"}
Jul 06 19:14:45.014474 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:45.014383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4" event={"ID":"937d06ab-1b50-4101-a978-2e7763ba1dcf","Type":"ContainerStarted","Data":"5e62bb3cad7fd045d49882122c1b162c7ba20bf25fb05071e8a87dc03f4278aa"}
Jul 06 19:14:45.032469 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:45.032423    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4" podStartSLOduration=0.947254845 podStartE2EDuration="2.032407775s" totalImagesPullingTime="1.08515293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:45.031511475 +0000 UTC m=+557.463769299" watchObservedRunningTime="2026-07-06 19:14:45.032407775 +0000 UTC m=+557.464665614"
Jul 06 19:14:49.919670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:49.919635    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-85wvp"
Jul 06 19:14:53.515539 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:53.515511    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:53.516121 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:53.515853    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:53.528167 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:53.528144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:14:54.077134 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:14:54.077103    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4"
Jul 06 19:15:00.135697 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.135659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:15:00.149274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.149246    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-4x5tj"]
Jul 06 19:15:00.152199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.152178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:00.160918 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.160888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-4x5tj"]
Jul 06 19:15:00.230264 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.230228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4md\" (UniqueName: \"kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md\") pod \"maas-api-key-cleanup-29722755-4x5tj\" (UID: \"def405cc-c090-4b8e-8803-2aa35ec8b172\") " pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:00.332404 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.332365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4md\" (UniqueName: \"kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md\") pod \"maas-api-key-cleanup-29722755-4x5tj\" (UID: \"def405cc-c090-4b8e-8803-2aa35ec8b172\") " pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:00.342298 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.342241    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4md\" (UniqueName: \"kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md\") pod \"maas-api-key-cleanup-29722755-4x5tj\" (UID: \"def405cc-c090-4b8e-8803-2aa35ec8b172\") " pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:00.464065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.463983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:00.803718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:00.803695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722755-4x5tj"]
Jul 06 19:15:00.805990 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:15:00.805963    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef405cc_c090_4b8e_8803_2aa35ec8b172.slice/crio-9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e WatchSource:0}: Error finding container 9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e: Status 404 returned error can't find the container with id 9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e
Jul 06 19:15:01.105148 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:01.105062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj" event={"ID":"def405cc-c090-4b8e-8803-2aa35ec8b172","Type":"ContainerStarted","Data":"9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e"}
Jul 06 19:15:04.124161 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:04.124130    2559 generic.go:356] "Generic (PLEG): container finished" podID="def405cc-c090-4b8e-8803-2aa35ec8b172" containerID="a0445d18fc38e4f4b1c23c68c9451ac66dfbfad81aa5260b874cef3b5da1c2cf" exitCode=0
Jul 06 19:15:04.124560 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:04.124213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj" event={"ID":"def405cc-c090-4b8e-8803-2aa35ec8b172","Type":"ContainerDied","Data":"a0445d18fc38e4f4b1c23c68c9451ac66dfbfad81aa5260b874cef3b5da1c2cf"}
Jul 06 19:15:05.260532 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:05.260505    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:05.281150 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:05.281123    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh4md\" (UniqueName: \"kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md\") pod \"def405cc-c090-4b8e-8803-2aa35ec8b172\" (UID: \"def405cc-c090-4b8e-8803-2aa35ec8b172\") "
Jul 06 19:15:05.283090 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:05.283056    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md" (OuterVolumeSpecName: "kube-api-access-xh4md") pod "def405cc-c090-4b8e-8803-2aa35ec8b172" (UID: "def405cc-c090-4b8e-8803-2aa35ec8b172"). InnerVolumeSpecName "kube-api-access-xh4md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:15:05.382325 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:05.382238    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh4md\" (UniqueName: \"kubernetes.io/projected/def405cc-c090-4b8e-8803-2aa35ec8b172-kube-api-access-xh4md\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:15:06.135658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:06.135629    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj"
Jul 06 19:15:06.143120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:06.143084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722755-4x5tj" event={"ID":"def405cc-c090-4b8e-8803-2aa35ec8b172","Type":"ContainerDied","Data":"9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e"}
Jul 06 19:15:06.143304 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:06.143147    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d2fe4c7d090f2def567722667db66bba711931a2324510c8ddbe1c62195fa3e"
Jul 06 19:15:12.619739 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:12.619701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:15:25.291559 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.291527    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"]
Jul 06 19:15:25.292032 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.292017    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def405cc-c090-4b8e-8803-2aa35ec8b172" containerName="cleanup"
Jul 06 19:15:25.292032 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.292033    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="def405cc-c090-4b8e-8803-2aa35ec8b172" containerName="cleanup"
Jul 06 19:15:25.292175 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.292129    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="def405cc-c090-4b8e-8803-2aa35ec8b172" containerName="cleanup"
Jul 06 19:15:25.295171 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.295150    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.298666 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.298646    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 19:15:25.306517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.306491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"]
Jul 06 19:15:25.313920 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.313886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:15:25.375373 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.375373 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.375585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15113697-81cb-4a5b-8f10-4110f557a8ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.375585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.375585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.375693 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.375594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wkj\" (UniqueName: \"kubernetes.io/projected/15113697-81cb-4a5b-8f10-4110f557a8ee-kube-api-access-h7wkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15113697-81cb-4a5b-8f10-4110f557a8ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476712 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476712 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476712 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wkj\" (UniqueName: \"kubernetes.io/projected/15113697-81cb-4a5b-8f10-4110f557a8ee-kube-api-access-h7wkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476831 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.476831 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.476762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.477134 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.477101    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.477241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.477157    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.477241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.477193    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.478907 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.478886    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15113697-81cb-4a5b-8f10-4110f557a8ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.479029 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.479000    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15113697-81cb-4a5b-8f10-4110f557a8ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.503172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.503139    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wkj\" (UniqueName: \"kubernetes.io/projected/15113697-81cb-4a5b-8f10-4110f557a8ee-kube-api-access-h7wkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk\" (UID: \"15113697-81cb-4a5b-8f10-4110f557a8ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.606396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.606307    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:25.748345 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:25.747782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"]
Jul 06 19:15:25.749114 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:15:25.748894    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15113697_81cb_4a5b_8f10_4110f557a8ee.slice/crio-3a874c03af3819c4f911f1496e37df01fda8fa2a5e6c38f1c70f2627adf6550c WatchSource:0}: Error finding container 3a874c03af3819c4f911f1496e37df01fda8fa2a5e6c38f1c70f2627adf6550c: Status 404 returned error can't find the container with id 3a874c03af3819c4f911f1496e37df01fda8fa2a5e6c38f1c70f2627adf6550c
Jul 06 19:15:26.242007 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:26.241909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk" event={"ID":"15113697-81cb-4a5b-8f10-4110f557a8ee","Type":"ContainerStarted","Data":"a14923ded1318d2c0d69d0559a7bac5e00adf8856828ec8b0df95a8e1f19bd21"}
Jul 06 19:15:26.242007 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:26.241974    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk" event={"ID":"15113697-81cb-4a5b-8f10-4110f557a8ee","Type":"ContainerStarted","Data":"3a874c03af3819c4f911f1496e37df01fda8fa2a5e6c38f1c70f2627adf6550c"}
Jul 06 19:15:26.262092 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:26.262047    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk" podStartSLOduration=1.040191413 podStartE2EDuration="1.262030463s" totalImagesPullingTime="221.83905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:26.259574365 +0000 UTC m=+598.691832211" watchObservedRunningTime="2026-07-06 19:15:26.262030463 +0000 UTC m=+598.694288287"
Jul 06 19:15:27.999239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:27.999208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:15:28.002171 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:28.002153    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:15:33.524000 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:33.523959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:15:35.607315 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:35.607272    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:35.607938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:35.607902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:35.626178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:35.626147    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:36.306724 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:36.306698    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk"
Jul 06 19:15:49.816601 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:15:49.816518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:03.686465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:03.686433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:53.512213 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:53.512177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:53.596625 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:53.596589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:54.297190 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.297150    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:16:54.297417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.297390    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" podUID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" containerName="authorino" containerID="cri-o://fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204" gracePeriod=30
Jul 06 19:16:54.548855 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.548795    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:16:54.630043 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.630013    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert\") pod \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") "
Jul 06 19:16:54.630043 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.630048    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgrsl\" (UniqueName: \"kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl\") pod \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\" (UID: \"ff9b4399-2cfc-4b14-bbd2-04ca352f406c\") "
Jul 06 19:16:54.631993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.631967    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl" (OuterVolumeSpecName: "kube-api-access-pgrsl") pod "ff9b4399-2cfc-4b14-bbd2-04ca352f406c" (UID: "ff9b4399-2cfc-4b14-bbd2-04ca352f406c"). InnerVolumeSpecName "kube-api-access-pgrsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:54.640653 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.640629    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ff9b4399-2cfc-4b14-bbd2-04ca352f406c" (UID: "ff9b4399-2cfc-4b14-bbd2-04ca352f406c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:16:54.712687 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.712652    2559 generic.go:356] "Generic (PLEG): container finished" podID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" containerID="fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204" exitCode=0
Jul 06 19:16:54.712874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.712697    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b547cdd8-dhg5d"
Jul 06 19:16:54.712874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.712712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" event={"ID":"ff9b4399-2cfc-4b14-bbd2-04ca352f406c","Type":"ContainerDied","Data":"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"}
Jul 06 19:16:54.712874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.712749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b547cdd8-dhg5d" event={"ID":"ff9b4399-2cfc-4b14-bbd2-04ca352f406c","Type":"ContainerDied","Data":"12018f0b0214fa1726ed13e8090e163f74e6855bd168711c4baa6fe46cbe05a8"}
Jul 06 19:16:54.712874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.712771    2559 scope.go:117] "RemoveContainer" containerID="fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"
Jul 06 19:16:54.722448 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.722430    2559 scope.go:117] "RemoveContainer" containerID="fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"
Jul 06 19:16:54.722702 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:16:54.722683    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204\": container with ID starting with fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204 not found: ID does not exist" containerID="fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"
Jul 06 19:16:54.722764 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.722715    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204"} err="failed to get container status \"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204\": rpc error: code = NotFound desc = could not find container \"fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204\": container with ID starting with fb44ee7c9067417346950b683140cfd4c969425043bc43fa0fef0a968581c204 not found: ID does not exist"
Jul 06 19:16:54.731481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.731461    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-tls-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:16:54.731481 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.731484    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrsl\" (UniqueName: \"kubernetes.io/projected/ff9b4399-2cfc-4b14-bbd2-04ca352f406c-kube-api-access-pgrsl\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:16:54.740778 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.740755    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:16:54.754155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.754129    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68b547cdd8-dhg5d"]
Jul 06 19:16:54.783716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.783676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:54.877886 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:54.877854    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:16:56.142419 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:16:56.142380    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" path="/var/lib/kubelet/pods/ff9b4399-2cfc-4b14-bbd2-04ca352f406c/volumes"
Jul 06 19:17:30.463160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:17:30.463129    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:17:30.564217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:17:30.564176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:17:35.456454 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:17:35.456417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:05.451147 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:05.451103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:05.504629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:05.504594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:06.229996 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.229963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:06.344465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.344432    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:18:06.344714 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.344666    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" podUID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" containerName="manager" containerID="cri-o://2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015" gracePeriod=30
Jul 06 19:18:06.602565 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.602541    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:18:06.719618 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.719587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca\") pod \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") "
Jul 06 19:18:06.719797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.719633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert\") pod \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") "
Jul 06 19:18:06.719797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.719673    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpwcc\" (UniqueName: \"kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc\") pod \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\" (UID: \"69e494d8-5d73-4d9c-b41b-970219ad4dd6\") "
Jul 06 19:18:06.720054 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.720025    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca" (OuterVolumeSpecName: "service-ca") pod "69e494d8-5d73-4d9c-b41b-970219ad4dd6" (UID: "69e494d8-5d73-4d9c-b41b-970219ad4dd6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:18:06.721742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.721711    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "69e494d8-5d73-4d9c-b41b-970219ad4dd6" (UID: "69e494d8-5d73-4d9c-b41b-970219ad4dd6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:18:06.721742 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.721724    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc" (OuterVolumeSpecName: "kube-api-access-cpwcc") pod "69e494d8-5d73-4d9c-b41b-970219ad4dd6" (UID: "69e494d8-5d73-4d9c-b41b-970219ad4dd6"). InnerVolumeSpecName "kube-api-access-cpwcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:18:06.820862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.820779    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69e494d8-5d73-4d9c-b41b-970219ad4dd6-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:18:06.820862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.820805    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69e494d8-5d73-4d9c-b41b-970219ad4dd6-webhook-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:18:06.820862 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:06.820818    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpwcc\" (UniqueName: \"kubernetes.io/projected/69e494d8-5d73-4d9c-b41b-970219ad4dd6-kube-api-access-cpwcc\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:18:07.096893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.096805    2559 generic.go:356] "Generic (PLEG): container finished" podID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" containerID="2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015" exitCode=0
Jul 06 19:18:07.096893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.096876    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-h892h"
Jul 06 19:18:07.097086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.096889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" event={"ID":"69e494d8-5d73-4d9c-b41b-970219ad4dd6","Type":"ContainerDied","Data":"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"}
Jul 06 19:18:07.097086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.096986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-h892h" event={"ID":"69e494d8-5d73-4d9c-b41b-970219ad4dd6","Type":"ContainerDied","Data":"e554ff738ff057c1b03df14a27437fdeb3e09644ac057f0769320c82306b43c0"}
Jul 06 19:18:07.097086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.097011    2559 scope.go:117] "RemoveContainer" containerID="2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"
Jul 06 19:18:07.106446 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.106422    2559 scope.go:117] "RemoveContainer" containerID="2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"
Jul 06 19:18:07.106681 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:18:07.106657    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015\": container with ID starting with 2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015 not found: ID does not exist" containerID="2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"
Jul 06 19:18:07.106735 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.106679    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015"} err="failed to get container status \"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015\": rpc error: code = NotFound desc = could not find container \"2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015\": container with ID starting with 2c964f6e109ec519dfbeae14146e8b75ab9f8d34fe5f9e7e00f86dc499354015 not found: ID does not exist"
Jul 06 19:18:07.118986 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.118960    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:18:07.122736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.122718    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-h892h"]
Jul 06 19:18:07.840687 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.840656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:07.976715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.976682    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-sdcmg"]
Jul 06 19:18:07.977152 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977139    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" containerName="manager"
Jul 06 19:18:07.977198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977155    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" containerName="manager"
Jul 06 19:18:07.977198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977184    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" containerName="authorino"
Jul 06 19:18:07.977198 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977189    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" containerName="authorino"
Jul 06 19:18:07.977296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977250    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" containerName="manager"
Jul 06 19:18:07.977296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.977259    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff9b4399-2cfc-4b14-bbd2-04ca352f406c" containerName="authorino"
Jul 06 19:18:07.980415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.980394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:07.984738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.984720    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:18:07.984842 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.984722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:18:07.984842 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.984783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-55bdk\""
Jul 06 19:18:07.991188 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:07.991167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-sdcmg"]
Jul 06 19:18:08.132410 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.132377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3b08083-eb61-415d-b78d-e65cc441c724-webhook-cert\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.132592 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.132442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntf4b\" (UniqueName: \"kubernetes.io/projected/f3b08083-eb61-415d-b78d-e65cc441c724-kube-api-access-ntf4b\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.132592 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.132493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b08083-eb61-415d-b78d-e65cc441c724-service-ca\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.144430 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.144402    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e494d8-5d73-4d9c-b41b-970219ad4dd6" path="/var/lib/kubelet/pods/69e494d8-5d73-4d9c-b41b-970219ad4dd6/volumes"
Jul 06 19:18:08.233492 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.233465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3b08083-eb61-415d-b78d-e65cc441c724-webhook-cert\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.233716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.233551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntf4b\" (UniqueName: \"kubernetes.io/projected/f3b08083-eb61-415d-b78d-e65cc441c724-kube-api-access-ntf4b\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.233716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.233593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b08083-eb61-415d-b78d-e65cc441c724-service-ca\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.234872 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.234846    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b08083-eb61-415d-b78d-e65cc441c724-service-ca\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.236287 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.236264    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3b08083-eb61-415d-b78d-e65cc441c724-webhook-cert\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.242192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.242170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntf4b\" (UniqueName: \"kubernetes.io/projected/f3b08083-eb61-415d-b78d-e65cc441c724-kube-api-access-ntf4b\") pod \"maas-controller-6fcff6bdb8-sdcmg\" (UID: \"f3b08083-eb61-415d-b78d-e65cc441c724\") " pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.292073 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.292042    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:08.422827 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.422797    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcff6bdb8-sdcmg"]
Jul 06 19:18:08.424264 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:18:08.424240    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b08083_eb61_415d_b78d_e65cc441c724.slice/crio-2a221ae51ac6b3371d541187b8e6e2f435319201adb93d0b9abab117d92ef6b2 WatchSource:0}: Error finding container 2a221ae51ac6b3371d541187b8e6e2f435319201adb93d0b9abab117d92ef6b2: Status 404 returned error can't find the container with id 2a221ae51ac6b3371d541187b8e6e2f435319201adb93d0b9abab117d92ef6b2
Jul 06 19:18:08.425656 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:08.425638    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:18:09.110882 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:09.110848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg" event={"ID":"f3b08083-eb61-415d-b78d-e65cc441c724","Type":"ContainerStarted","Data":"447c5cc4f6a4971bc768c5024edc2b76da259cbb5631dd1748899bc11435dc71"}
Jul 06 19:18:09.111273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:09.110901    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg" event={"ID":"f3b08083-eb61-415d-b78d-e65cc441c724","Type":"ContainerStarted","Data":"2a221ae51ac6b3371d541187b8e6e2f435319201adb93d0b9abab117d92ef6b2"}
Jul 06 19:18:09.111273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:09.110947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:09.129483 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:09.129436    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg" podStartSLOduration=1.658229783 podStartE2EDuration="2.129420767s" totalImagesPullingTime="471.190984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:09.127371379 +0000 UTC m=+761.559629204" watchObservedRunningTime="2026-07-06 19:18:09.129420767 +0000 UTC m=+761.561678632"
Jul 06 19:18:20.120721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:20.120690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fcff6bdb8-sdcmg"
Jul 06 19:18:33.880486 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:33.880443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:41.630409 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:41.630364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:41.738773 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:41.738739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:41.880680 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:41.880578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:47.469092 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:47.469051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:47.535667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:47.535630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:47.616403 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:47.616367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:47.714803 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:47.714771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:47.843846 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:47.843780    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:53.417693 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:53.417618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:18:53.518679 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:18:53.518645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:28.040990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:20:28.040964    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:20:28.041791 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:20:28.041766    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:23:10.218472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:23:10.218438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:46.673126 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:23:46.673090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:55.427808 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:23:55.427779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:31.417318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:24:31.417284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:28.075920 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:25:28.075890    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:25:28.078449 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:25:28.077714    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:30:00.142943 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.142906    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-27t8r"]
Jul 06 19:30:00.146432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.146414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:00.158682 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.158651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-27t8r"]
Jul 06 19:30:00.247009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.246978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dcp\" (UniqueName: \"kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp\") pod \"maas-api-key-cleanup-29722770-27t8r\" (UID: \"5fb7e388-0f23-42ab-aab4-39e5d769bf66\") " pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:00.347762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.347728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dcp\" (UniqueName: \"kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp\") pod \"maas-api-key-cleanup-29722770-27t8r\" (UID: \"5fb7e388-0f23-42ab-aab4-39e5d769bf66\") " pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:00.356219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.356197    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dcp\" (UniqueName: \"kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp\") pod \"maas-api-key-cleanup-29722770-27t8r\" (UID: \"5fb7e388-0f23-42ab-aab4-39e5d769bf66\") " pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:00.456534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.456483    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:00.792389 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.792364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-27t8r"]
Jul 06 19:30:00.793481 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:30:00.793457    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb7e388_0f23_42ab_aab4_39e5d769bf66.slice/crio-99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86 WatchSource:0}: Error finding container 99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86: Status 404 returned error can't find the container with id 99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86
Jul 06 19:30:00.850187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:00.850161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r" event={"ID":"5fb7e388-0f23-42ab-aab4-39e5d769bf66","Type":"ContainerStarted","Data":"99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86"}
Jul 06 19:30:01.856839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:01.856757    2559 generic.go:356] "Generic (PLEG): container finished" podID="5fb7e388-0f23-42ab-aab4-39e5d769bf66" containerID="8b5b3c348268b8681e58831316dd3fac3924422bd7ef110d49a2052db295a676" exitCode=0
Jul 06 19:30:01.856839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:01.856792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r" event={"ID":"5fb7e388-0f23-42ab-aab4-39e5d769bf66","Type":"ContainerDied","Data":"8b5b3c348268b8681e58831316dd3fac3924422bd7ef110d49a2052db295a676"}
Jul 06 19:30:02.998388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:02.998366    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:03.174288 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.174206    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6dcp\" (UniqueName: \"kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp\") pod \"5fb7e388-0f23-42ab-aab4-39e5d769bf66\" (UID: \"5fb7e388-0f23-42ab-aab4-39e5d769bf66\") "
Jul 06 19:30:03.176399 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.176370    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp" (OuterVolumeSpecName: "kube-api-access-w6dcp") pod "5fb7e388-0f23-42ab-aab4-39e5d769bf66" (UID: "5fb7e388-0f23-42ab-aab4-39e5d769bf66"). InnerVolumeSpecName "kube-api-access-w6dcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:03.276126 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.276093    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6dcp\" (UniqueName: \"kubernetes.io/projected/5fb7e388-0f23-42ab-aab4-39e5d769bf66-kube-api-access-w6dcp\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:03.874982 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.874950    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r"
Jul 06 19:30:03.875197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.874978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-27t8r" event={"ID":"5fb7e388-0f23-42ab-aab4-39e5d769bf66","Type":"ContainerDied","Data":"99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86"}
Jul 06 19:30:03.875197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:03.875047    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99e381253181646bc2bca3c2c58edb89325dcac2beaa884b8b7b512d32232a86"
Jul 06 19:30:17.084100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:17.084068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:21.666887 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:21.666851    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:24.627140 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:24.627096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:24.727762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:24.727719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:26.661414 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:26.661385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:28.109728 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:28.109625    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:30:28.114727 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:28.112433    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:30:29.922750 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:29.922718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:35.040177 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:35.040136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:38.002424 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:38.002388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:38.101734 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:38.101704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:38.468876 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:38.468835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.207259 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.207227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.307403 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.307366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.387068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.387024    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:44.387670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.387639    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb7e388-0f23-42ab-aab4-39e5d769bf66" containerName="cleanup"
Jul 06 19:30:44.387670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.387666    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb7e388-0f23-42ab-aab4-39e5d769bf66" containerName="cleanup"
Jul 06 19:30:44.387853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.387811    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb7e388-0f23-42ab-aab4-39e5d769bf66" containerName="cleanup"
Jul 06 19:30:44.391214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.391191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.395866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.394323    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f84be3f0-openshift-default-dockercfg-cksv2\""
Jul 06 19:30:44.408873 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.408844    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:44.433986 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.433955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.489047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.488961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.532600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.532804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.532804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.532804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.532804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl4xw\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.533075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.533075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.533075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.533075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.532967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.633897 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.633851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.633897 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.633897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.633957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl4xw\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634449 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634449 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634592    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634777 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634750    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634788    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.634860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634810    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.635003 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.634857    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.636454 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.636429    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.636651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.636620    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.642392 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.642369    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.642392 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.642381    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl4xw\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw\") pod \"e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") " pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.708655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.708622    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:44.850835 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.850805    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:44.852008 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:30:44.851978    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a53f78_0339_4030_bed9_0a7a277f1425.slice/crio-18934d0253e4a07e64c04ed91b4584000b7412b2eee4ef1aa4b7f77c7a15513e WatchSource:0}: Error finding container 18934d0253e4a07e64c04ed91b4584000b7412b2eee4ef1aa4b7f77c7a15513e: Status 404 returned error can't find the container with id 18934d0253e4a07e64c04ed91b4584000b7412b2eee4ef1aa4b7f77c7a15513e
Jul 06 19:30:44.854144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.854109    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:30:44.854212 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.854179    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:30:44.854256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:44.854213    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:30:45.107336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.107247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" event={"ID":"76a53f78-0339-4030-bed9-0a7a277f1425","Type":"ContainerStarted","Data":"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"}
Jul 06 19:30:45.107336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.107316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" event={"ID":"76a53f78-0339-4030-bed9-0a7a277f1425","Type":"ContainerStarted","Data":"18934d0253e4a07e64c04ed91b4584000b7412b2eee4ef1aa4b7f77c7a15513e"}
Jul 06 19:30:45.128288 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.128245    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" podStartSLOduration=1.128229168 podStartE2EDuration="1.128229168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:45.126743748 +0000 UTC m=+1517.559001584" watchObservedRunningTime="2026-07-06 19:30:45.128229168 +0000 UTC m=+1517.560486991"
Jul 06 19:30:45.513183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.513145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:45.573465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.573430    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:45.577781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.577761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.580752 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.580734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f84be3f0-serving-cert\""
Jul 06 19:30:45.589087 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.589057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:45.601370 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.601339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:45.642759 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.642730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjv97\" (UniqueName: \"kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.642759 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.642766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.642990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.642849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.672658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.672631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:45.708920 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.708887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:45.714146 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.714123    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:45.744357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.744330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.744482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.744418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjv97\" (UniqueName: \"kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.744482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.744439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.744482 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:30:45.744474    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-f84be3f0-serving-cert: secret "maas-api-e2e-ait-f84be3f0-serving-cert" not found
Jul 06 19:30:45.744645 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:30:45.744542    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls podName:a2acfb17-c528-4f81-a373-c5859017c2c7 nodeName:}" failed. No retries permitted until 2026-07-06 19:30:46.244523052 +0000 UTC m=+1518.676780855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls") pod "maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" (UID: "a2acfb17-c528-4f81-a373-c5859017c2c7") : secret "maas-api-e2e-ait-f84be3f0-serving-cert" not found
Jul 06 19:30:45.745107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.745087    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.753526 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.753505    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjv97\" (UniqueName: \"kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:45.868169 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:45.868139    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.113395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.113372    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:46.114208 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.114191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:46.246610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.246571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.249849 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.249829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:46.252331 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.252309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") pod \"maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") " pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:46.347502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.347464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:46.489758 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.489673    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:46.641343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.641312    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:46.643014 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:30:46.642988    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2acfb17_c528_4f81_a373_c5859017c2c7.slice/crio-90d9742e3e49bc8a6ec931892fa9ec60c70281a32c5c8d78843e18f7364012e3 WatchSource:0}: Error finding container 90d9742e3e49bc8a6ec931892fa9ec60c70281a32c5c8d78843e18f7364012e3: Status 404 returned error can't find the container with id 90d9742e3e49bc8a6ec931892fa9ec60c70281a32c5c8d78843e18f7364012e3
Jul 06 19:30:46.644508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:46.644492    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:30:47.119996 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:47.119956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" event={"ID":"a2acfb17-c528-4f81-a373-c5859017c2c7","Type":"ContainerStarted","Data":"90d9742e3e49bc8a6ec931892fa9ec60c70281a32c5c8d78843e18f7364012e3"}
Jul 06 19:30:48.128008 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:48.127969    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" event={"ID":"a2acfb17-c528-4f81-a373-c5859017c2c7","Type":"ContainerStarted","Data":"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"}
Jul 06 19:30:48.149972 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:48.148472    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" podStartSLOduration=2.471405383 podStartE2EDuration="3.14845136s" totalImagesPullingTime="677.045977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:48.144532417 +0000 UTC m=+1520.576790242" watchObservedRunningTime="2026-07-06 19:30:48.14845136 +0000 UTC m=+1520.580709186"
Jul 06 19:30:48.809111 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:48.809081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:49.134112 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:49.134079    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:53.629094 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.629057    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:53.629450 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.629375    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" podUID="a2acfb17-c528-4f81-a373-c5859017c2c7" containerName="maas-api" containerID="cri-o://f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf" gracePeriod=30
Jul 06 19:30:53.635365 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.635342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:53.647708 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.647673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.706572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.706547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.783037 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.783007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:53.783344 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.783305    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" podUID="76a53f78-0339-4030-bed9-0a7a277f1425" containerName="istio-proxy" containerID="cri-o://62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592" gracePeriod=30
Jul 06 19:30:53.806870 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.806838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.893214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.893164    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:53.906711 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:53.906670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:54.026323 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.026295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca\") pod \"a2acfb17-c528-4f81-a373-c5859017c2c7\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") "
Jul 06 19:30:54.026493 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.026393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") pod \"a2acfb17-c528-4f81-a373-c5859017c2c7\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") "
Jul 06 19:30:54.026493 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.026443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjv97\" (UniqueName: \"kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97\") pod \"a2acfb17-c528-4f81-a373-c5859017c2c7\" (UID: \"a2acfb17-c528-4f81-a373-c5859017c2c7\") "
Jul 06 19:30:54.026678 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.026653    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2acfb17-c528-4f81-a373-c5859017c2c7" (UID: "a2acfb17-c528-4f81-a373-c5859017c2c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:54.028278 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.028254    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2acfb17-c528-4f81-a373-c5859017c2c7" (UID: "a2acfb17-c528-4f81-a373-c5859017c2c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:30:54.028420 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.028395    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97" (OuterVolumeSpecName: "kube-api-access-qjv97") pod "a2acfb17-c528-4f81-a373-c5859017c2c7" (UID: "a2acfb17-c528-4f81-a373-c5859017c2c7"). InnerVolumeSpecName "kube-api-access-qjv97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:54.128093 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.128066    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2acfb17-c528-4f81-a373-c5859017c2c7-maas-api-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:54.128093 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.128088    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjv97\" (UniqueName: \"kubernetes.io/projected/a2acfb17-c528-4f81-a373-c5859017c2c7-kube-api-access-qjv97\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:54.128093 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.128099    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2acfb17-c528-4f81-a373-c5859017c2c7-openshift-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:54.162068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.162040    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2acfb17-c528-4f81-a373-c5859017c2c7" containerID="f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf" exitCode=0
Jul 06 19:30:54.162187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.162075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" event={"ID":"a2acfb17-c528-4f81-a373-c5859017c2c7","Type":"ContainerDied","Data":"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"}
Jul 06 19:30:54.162187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.162083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"
Jul 06 19:30:54.162187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.162106    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn" event={"ID":"a2acfb17-c528-4f81-a373-c5859017c2c7","Type":"ContainerDied","Data":"90d9742e3e49bc8a6ec931892fa9ec60c70281a32c5c8d78843e18f7364012e3"}
Jul 06 19:30:54.162187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.162128    2559 scope.go:117] "RemoveContainer" containerID="f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"
Jul 06 19:30:54.170673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.170654    2559 scope.go:117] "RemoveContainer" containerID="f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"
Jul 06 19:30:54.170949 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:30:54.170907    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf\": container with ID starting with f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf not found: ID does not exist" containerID="f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"
Jul 06 19:30:54.171026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.170945    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf"} err="failed to get container status \"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf\": rpc error: code = NotFound desc = could not find container \"f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf\": container with ID starting with f01186b8bf239c78ca8bc14e4631c201f9cb99b1157d27293c8c0f52021293bf not found: ID does not exist"
Jul 06 19:30:54.192973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.192950    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:54.196349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:54.196329    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f84be3f0-ddbd7654b-8chnn"]
Jul 06 19:30:55.147817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:55.147782    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:56.141806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:56.141772    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2acfb17-c528-4f81-a373-c5859017c2c7" path="/var/lib/kubelet/pods/a2acfb17-c528-4f81-a373-c5859017c2c7/volumes"
Jul 06 19:30:59.064334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.064311    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:59.085219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085247    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085274    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085352 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085475    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085504    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl4xw\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw\") pod \"76a53f78-0339-4030-bed9-0a7a277f1425\" (UID: \"76a53f78-0339-4030-bed9-0a7a277f1425\") "
Jul 06 19:30:59.085567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085519    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:59.085843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085671    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:59.085843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085754    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:59.085843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085803    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:59.086026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085871    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.086026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085892    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a53f78-0339-4030-bed9-0a7a277f1425-istiod-ca-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.086026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085906    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-workload-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.086026 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.085920    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-credential-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.086408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.086356    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data" (OuterVolumeSpecName: "istio-data") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:59.087762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.087736    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw" (OuterVolumeSpecName: "kube-api-access-jl4xw") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "kube-api-access-jl4xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:59.087868 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.087837    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:30:59.087945 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.087904    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:59.087994 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.087948    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token" (OuterVolumeSpecName: "istio-token") pod "76a53f78-0339-4030-bed9-0a7a277f1425" (UID: "76a53f78-0339-4030-bed9-0a7a277f1425"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:59.187732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.187701    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-envoy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.187732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.187734    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-istio-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.187732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.187749    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a53f78-0339-4030-bed9-0a7a277f1425-istio-podinfo\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.187732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.187765    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl4xw\" (UniqueName: \"kubernetes.io/projected/76a53f78-0339-4030-bed9-0a7a277f1425-kube-api-access-jl4xw\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.187732 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.187781    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a53f78-0339-4030-bed9-0a7a277f1425-istio-data\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:30:59.195239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.195209    2559 generic.go:356] "Generic (PLEG): container finished" podID="76a53f78-0339-4030-bed9-0a7a277f1425" containerID="62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592" exitCode=0
Jul 06 19:30:59.195364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.195254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"
Jul 06 19:30:59.195364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.195277    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" event={"ID":"76a53f78-0339-4030-bed9-0a7a277f1425","Type":"ContainerDied","Data":"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"}
Jul 06 19:30:59.195364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.195322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9" event={"ID":"76a53f78-0339-4030-bed9-0a7a277f1425","Type":"ContainerDied","Data":"18934d0253e4a07e64c04ed91b4584000b7412b2eee4ef1aa4b7f77c7a15513e"}
Jul 06 19:30:59.195364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.195342    2559 scope.go:117] "RemoveContainer" containerID="62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"
Jul 06 19:30:59.205541 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.205523    2559 scope.go:117] "RemoveContainer" containerID="62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"
Jul 06 19:30:59.205823 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:30:59.205804    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592\": container with ID starting with 62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592 not found: ID does not exist" containerID="62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"
Jul 06 19:30:59.205867 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.205833    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592"} err="failed to get container status \"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592\": rpc error: code = NotFound desc = could not find container \"62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592\": container with ID starting with 62a4a0b79c2f63013d042c5f4c30260074a1cd0542dab0494ef861c0ff2f0592 not found: ID does not exist"
Jul 06 19:30:59.218961 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.218915    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:59.222433 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.222414    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f84be3f0-openshift-default-7b8c8b599f-z96x9"]
Jul 06 19:30:59.717110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.717076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:59.817301 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.817270    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:59.894120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894089    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:30:59.894779 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894756    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a53f78-0339-4030-bed9-0a7a277f1425" containerName="istio-proxy"
Jul 06 19:30:59.894779 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894781    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a53f78-0339-4030-bed9-0a7a277f1425" containerName="istio-proxy"
Jul 06 19:30:59.894990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894798    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2acfb17-c528-4f81-a373-c5859017c2c7" containerName="maas-api"
Jul 06 19:30:59.894990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894807    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2acfb17-c528-4f81-a373-c5859017c2c7" containerName="maas-api"
Jul 06 19:30:59.895066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.894986    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2acfb17-c528-4f81-a373-c5859017c2c7" containerName="maas-api"
Jul 06 19:30:59.895066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.895003    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a53f78-0339-4030-bed9-0a7a277f1425" containerName="istio-proxy"
Jul 06 19:30:59.899856 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.899835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.902858 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.902840    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f8415d16-openshift-default-dockercfg-qckct\""
Jul 06 19:30:59.910745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.910723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:30:59.930492 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.930472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:59.991829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.991771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:59.995037 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995095 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gf8q\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995095 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995168 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995201 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995245 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995329 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:30:59.995364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:30:59.995337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.095890 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.095863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.095895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.095953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.095989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gf8q\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096312    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096356    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096706 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096571    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096840 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096768    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.096972 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.096955    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.098762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.098736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.098902 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.098885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.104653 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.104634    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.105025 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.105009    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gf8q\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q\") pod \"e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") " pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.144876 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.144852    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a53f78-0339-4030-bed9-0a7a277f1425" path="/var/lib/kubelet/pods/76a53f78-0339-4030-bed9-0a7a277f1425/volumes"
Jul 06 19:31:00.213576 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.213554    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:00.365260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.365234    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:31:00.366302 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:31:00.366278    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636e1d90_f3ee_438e_9612_4b6dc82ac471.slice/crio-ba3349e5f2aae1aba1570f862eec514ff4c151bcf25760ca3de0cf6ec762182c WatchSource:0}: Error finding container ba3349e5f2aae1aba1570f862eec514ff4c151bcf25760ca3de0cf6ec762182c: Status 404 returned error can't find the container with id ba3349e5f2aae1aba1570f862eec514ff4c151bcf25760ca3de0cf6ec762182c
Jul 06 19:31:00.368620 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.368579    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:00.368705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.368674    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:00.368744 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:00.368722    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:01.027546 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.027502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.107756 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.107728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.174227 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.174195    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.209893 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.209846    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerStarted","Data":"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"}
Jul 06 19:31:01.210063 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.209916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerStarted","Data":"ba3349e5f2aae1aba1570f862eec514ff4c151bcf25760ca3de0cf6ec762182c"}
Jul 06 19:31:01.213883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.213864    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:01.218974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.218953    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:01.235447 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.235407    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" podStartSLOduration=2.235384406 podStartE2EDuration="2.235384406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:01.232332256 +0000 UTC m=+1533.664590105" watchObservedRunningTime="2026-07-06 19:31:01.235384406 +0000 UTC m=+1533.667642229"
Jul 06 19:31:01.443670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.443640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.648993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.648956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:01.746669 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:01.746586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:02.218843 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:02.218811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:02.222435 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:02.222412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:03.304942 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:03.304898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:09.194414 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:09.194380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:09.261684 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:09.261648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:12.293116 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.293025    2559 generic.go:356] "Generic (PLEG): container finished" podID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerID="bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c" exitCode=0
Jul 06 19:31:12.293116 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.293102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerDied","Data":"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"}
Jul 06 19:31:12.293524 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.293425    2559 scope.go:117] "RemoveContainer" containerID="bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"
Jul 06 19:31:12.294480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.294455    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:12.294536 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.294523    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:12.294573 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:12.294557    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:31:13.301847 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:13.301812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerStarted","Data":"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"}
Jul 06 19:31:14.214236 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:14.214202    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:14.215591 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:14.215565    2559 patch_prober.go:28] interesting pod/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 19:31:14.215710 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:14.215616    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 19:31:15.141665 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.141628    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:31:15.158224 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.158192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:15.214023 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.213991    2559 patch_prober.go:28] interesting pod/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 19:31:15.214252 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.214058    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 19:31:15.262741 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.262709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:15.311898 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:15.311855    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy" containerID="cri-o://0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258" gracePeriod=30
Jul 06 19:31:17.219456 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:17.219422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:20.957968 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:20.957920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:21.059260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:21.059219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:21.174624 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:21.174592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:22.282498 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.282470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:22.392192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.392159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:22.482793 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.482748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:22.662105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.662081    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:22.731938 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.731903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732080 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732005    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732080 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732027    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732080 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732052    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732200 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732107    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732200 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732147    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732200 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732175    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732201    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732357 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732235    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gf8q\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q\") pod \"636e1d90-f3ee-438e-9612-4b6dc82ac471\" (UID: \"636e1d90-f3ee-438e-9612-4b6dc82ac471\") "
Jul 06 19:31:22.732462 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732416    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:22.732462 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732430    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:22.732606 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732586    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:22.732663 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732640    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-credential-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.732714 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732661    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.732774 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.732755    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:31:22.733123 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.733093    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data" (OuterVolumeSpecName: "istio-data") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:22.734495 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.734456    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:31:22.734603 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.734537    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:22.734603 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.734558    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token" (OuterVolumeSpecName: "istio-token") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:22.734733 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.734716    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q" (OuterVolumeSpecName: "kube-api-access-6gf8q") pod "636e1d90-f3ee-438e-9612-4b6dc82ac471" (UID: "636e1d90-f3ee-438e-9612-4b6dc82ac471"). InnerVolumeSpecName "kube-api-access-6gf8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833207    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-data\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833233    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-podinfo\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833242    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/636e1d90-f3ee-438e-9612-4b6dc82ac471-istiod-ca-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833250    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gf8q\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-kube-api-access-6gf8q\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833261    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-envoy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833269    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/636e1d90-f3ee-438e-9612-4b6dc82ac471-istio-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.833290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.833277    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/636e1d90-f3ee-438e-9612-4b6dc82ac471-workload-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:31:22.967523 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:22.967491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:23.066727 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.066692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:23.358246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.358213    2559 generic.go:356] "Generic (PLEG): container finished" podID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerID="0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258" exitCode=0
Jul 06 19:31:23.358658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.358272    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"
Jul 06 19:31:23.358658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.358287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerDied","Data":"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"}
Jul 06 19:31:23.358658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.358348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f" event={"ID":"636e1d90-f3ee-438e-9612-4b6dc82ac471","Type":"ContainerDied","Data":"ba3349e5f2aae1aba1570f862eec514ff4c151bcf25760ca3de0cf6ec762182c"}
Jul 06 19:31:23.358658 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.358373    2559 scope.go:117] "RemoveContainer" containerID="0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"
Jul 06 19:31:23.368441 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.368422    2559 scope.go:117] "RemoveContainer" containerID="bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"
Jul 06 19:31:23.376430 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.376412    2559 scope.go:117] "RemoveContainer" containerID="0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"
Jul 06 19:31:23.376654 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:31:23.376635    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258\": container with ID starting with 0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258 not found: ID does not exist" containerID="0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"
Jul 06 19:31:23.376700 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.376663    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258"} err="failed to get container status \"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258\": rpc error: code = NotFound desc = could not find container \"0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258\": container with ID starting with 0b6e782885091a896d5947bbbdc00d2ddb4c82850c62e254b8f626d856024258 not found: ID does not exist"
Jul 06 19:31:23.376700 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.376681    2559 scope.go:117] "RemoveContainer" containerID="bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"
Jul 06 19:31:23.376960 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:31:23.376939    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c\": container with ID starting with bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c not found: ID does not exist" containerID="bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"
Jul 06 19:31:23.377028 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.376969    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c"} err="failed to get container status \"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c\": rpc error: code = NotFound desc = could not find container \"bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c\": container with ID starting with bfe6347188050aab27799246a6965aabd369bc62a0dec30ab71ae93f0195eb1c not found: ID does not exist"
Jul 06 19:31:23.382507 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.382487    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:31:23.388568 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:23.388548    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f8415d16-openshift-default-85ff4c4d89-j5v8f"]
Jul 06 19:31:24.142588 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:24.142553    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" path="/var/lib/kubelet/pods/636e1d90-f3ee-438e-9612-4b6dc82ac471/volumes"
Jul 06 19:31:26.578848 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:26.578810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:26.634501 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:26.634466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:29.725159 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:29.725128    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:29.784944 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:29.784892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:29.890748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:29.890721    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:29.992914 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:29.992836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:30.066602 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:30.066575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:30.520558 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:30.520530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:31.595336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:31.595309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:35.879667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:35.879632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:35.976234 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:35.976202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:36.361537 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:36.361480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:36.451436 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:36.451403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:36.509235 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:36.509210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:37.972860 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:37.972821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:43.720137 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:43.720104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:43.787434 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:43.787398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:43.866997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:43.866962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:43.965278 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:43.965237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:44.074388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:44.074303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:44.465724 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:44.465692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:48.870338 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:31:48.870305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:10.451202 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:10.451102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:16.213894 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:16.213861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:16.323251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:16.323222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:16.414354 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:16.414328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:16.907274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:16.907248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:19.014941 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:19.014889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:32.319553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:32.319511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:33.583804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:33.583767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:37.906662 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:37.906625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:38.012129 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:38.012096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:38.107751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:38.107719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:48.657165 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:48.657133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:49.474654 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:49.474623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:55.359349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:55.359315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:55.424830 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:55.424797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:55.511168 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:55.511125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:55.611480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:55.611454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:55.710185 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:55.710154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:56.484525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:56.484472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:56.573490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:56.573462    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:56.673334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:56.673303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:58.339224 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:32:58.339186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:04.043818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:04.043787    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:04.145142 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:04.145110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:04.728822 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:04.728791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:10.685301 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:10.685265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:10.748132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:10.748094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:10.969630 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:10.969545    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:11.255099 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:11.255015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:11.810214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:11.810185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.167182 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.167148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.250252 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.250219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.314961 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.314897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.600254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.600162    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.799710 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.799683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:14.895981 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:14.895956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:18.680286 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:18.680256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:19.356234 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:19.356198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:19.455369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:19.455326    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:19.801764 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:19.801731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:25.661568 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:25.661534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:25.735411 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:25.735378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:26.114192 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:26.114159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:26.402454 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:26.402374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:26.467474 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:26.467446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:29.146326 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:29.146285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:29.246534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:29.246493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.154506 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.154474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.221295 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.221268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.434236 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.434157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.648841 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.648805    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.778613 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.778518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.872736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.872679    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:32.999955 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:32.999885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:38.620963 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:38.620911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:38.688419 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:38.688388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:38.779105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:38.779071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:38.878745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:38.878651    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:38.980044 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:38.980011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:44.730417 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:44.730373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:44.979115 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:44.979077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:51.585350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:51.585273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:52.027363 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:52.027329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:52.201817 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:52.201786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.007865 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.007837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.101475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.101443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.189991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.189957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.482209 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.482179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.659801 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.659775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.759605 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:55.759522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:59.501401 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:33:59.501366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:08.687528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.687482    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:34:08.688046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688030    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.688110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688049    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.688110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688072    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.688110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688078    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.688238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688145    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.688238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.688156    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="636e1d90-f3ee-438e-9612-4b6dc82ac471" containerName="istio-proxy"
Jul 06 19:34:08.691153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.691139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.695800 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.695775    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-08ef9dd4\"/\"openshift-service-ca.crt\""
Jul 06 19:34:08.695949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.695801    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-08ef9dd4\"/\"e2e-lifecycle-model-08ef9dd4-kserve-self-signed-certs\""
Jul 06 19:34:08.695949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.695801    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-08ef9dd4\"/\"kube-root-ca.crt\""
Jul 06 19:34:08.695949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.695857    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-08ef9dd4\"/\"default-dockercfg-9st5c\""
Jul 06 19:34:08.701877 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.701855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:34:08.763659 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.763818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.763818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.763818 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkf4k\" (UniqueName: \"kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.763950 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.763950 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.763887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.780959 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.780914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:08.864615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.864768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.864839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.864991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.864991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkf4k\" (UniqueName: \"kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.864991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.864983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.865185 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.865087    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.865239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.865219    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.865303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.865261    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.866987 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.866961    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.867170 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.867152    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:08.872681 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:08.872665    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkf4k\" (UniqueName: \"kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k\") pod \"e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") " pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:09.001440 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:09.001358    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:09.142242 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:09.142216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:34:09.144046 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:34:09.144016    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd29355e0_6ce7_4891_b7da_7481592fef66.slice/crio-16f4a5b6738ab128f354de312b658adaee817201593be337e4d245e428c7aa51 WatchSource:0}: Error finding container 16f4a5b6738ab128f354de312b658adaee817201593be337e4d245e428c7aa51: Status 404 returned error can't find the container with id 16f4a5b6738ab128f354de312b658adaee817201593be337e4d245e428c7aa51
Jul 06 19:34:09.228597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:09.228565    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" event={"ID":"d29355e0-6ce7-4891-b7da-7481592fef66","Type":"ContainerStarted","Data":"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"}
Jul 06 19:34:09.228741 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:09.228609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" event={"ID":"d29355e0-6ce7-4891-b7da-7481592fef66","Type":"ContainerStarted","Data":"16f4a5b6738ab128f354de312b658adaee817201593be337e4d245e428c7aa51"}
Jul 06 19:34:09.248531 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:09.248485    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" podStartSLOduration=1.248465678 podStartE2EDuration="1.248465678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:09.246396228 +0000 UTC m=+1721.678654052" watchObservedRunningTime="2026-07-06 19:34:09.248465678 +0000 UTC m=+1721.680723496"
Jul 06 19:34:19.002430 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:19.002393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:19.002819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:19.002442    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:19.015088 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:19.015065    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:19.298683 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:19.298597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:34:37.062217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:37.062182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:37.349670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:37.349587    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:43.166747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:43.166703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:48.152662 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:48.152630    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:34:48.246832 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:34:48.246803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:03.173486 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.173447    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" podUID="d29355e0-6ce7-4891-b7da-7481592fef66" containerName="main" containerID="cri-o://f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994" gracePeriod=45
Jul 06 19:35:03.420545 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.420524    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:35:03.494794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.494713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.494794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.494752    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.494794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.494772    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.495086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.494801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.495086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.494858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkf4k\" (UniqueName: \"kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.495086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495033    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache" (OuterVolumeSpecName: "model-cache") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:03.495086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495058    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home" (OuterVolumeSpecName: "home") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:03.495086 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495071    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:03.495335 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495094    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm\") pod \"d29355e0-6ce7-4891-b7da-7481592fef66\" (UID: \"d29355e0-6ce7-4891-b7da-7481592fef66\") "
Jul 06 19:35:03.495479 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495460    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-home\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:03.495538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495507    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-tmp-dir\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:03.495538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.495522    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-model-cache\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:03.497150 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.497120    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k" (OuterVolumeSpecName: "kube-api-access-rkf4k") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "kube-api-access-rkf4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:03.497256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.497163    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm" (OuterVolumeSpecName: "dshm") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:03.497256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.497172    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d29355e0-6ce7-4891-b7da-7481592fef66" (UID: "d29355e0-6ce7-4891-b7da-7481592fef66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:03.520525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.520494    2559 generic.go:356] "Generic (PLEG): container finished" podID="d29355e0-6ce7-4891-b7da-7481592fef66" containerID="f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994" exitCode=0
Jul 06 19:35:03.520655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.520539    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"
Jul 06 19:35:03.520655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.520543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" event={"ID":"d29355e0-6ce7-4891-b7da-7481592fef66","Type":"ContainerDied","Data":"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"}
Jul 06 19:35:03.520655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.520584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2" event={"ID":"d29355e0-6ce7-4891-b7da-7481592fef66","Type":"ContainerDied","Data":"16f4a5b6738ab128f354de312b658adaee817201593be337e4d245e428c7aa51"}
Jul 06 19:35:03.520655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.520607    2559 scope.go:117] "RemoveContainer" containerID="f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"
Jul 06 19:35:03.530193 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.530178    2559 scope.go:117] "RemoveContainer" containerID="f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"
Jul 06 19:35:03.530501 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:35:03.530481    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994\": container with ID starting with f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994 not found: ID does not exist" containerID="f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"
Jul 06 19:35:03.530565 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.530515    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994"} err="failed to get container status \"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994\": rpc error: code = NotFound desc = could not find container \"f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994\": container with ID starting with f339d6c78ecac21f8e8fcd1e16e26265a4af0d0c966adf4fe8662699b8028994 not found: ID does not exist"
Jul 06 19:35:03.552689 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.552659    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:35:03.558470 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.558449    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-08ef9dd4/e2e-lifecycle-model-08ef9dd4-kserve-5bc67ff667-hj2p2"]
Jul 06 19:35:03.596724 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.596699    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29355e0-6ce7-4891-b7da-7481592fef66-tls-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:03.596724 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.596721    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkf4k\" (UniqueName: \"kubernetes.io/projected/d29355e0-6ce7-4891-b7da-7481592fef66-kube-api-access-rkf4k\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:03.596869 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:03.596729    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29355e0-6ce7-4891-b7da-7481592fef66-dshm\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:35:04.142098 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:04.142070    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d29355e0-6ce7-4891-b7da-7481592fef66" path="/var/lib/kubelet/pods/d29355e0-6ce7-4891-b7da-7481592fef66/volumes"
Jul 06 19:35:24.860822 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:24.860786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:26.312946 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:26.312899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:28.151748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:28.151713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:35:28.154642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:28.154619    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:35:31.105536 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:31.105497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:36.599557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:36.599520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:36.700659 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:36.700628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:36.903373 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:36.903340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:37.110659 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:37.110626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:38.166082 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:38.166041    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:38.262452 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:38.262420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:38.363081 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:38.363051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:39.130055 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:39.130019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:39.226347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:39.226305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:39.340489 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:39.340459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:40.726778 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:40.726743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:46.495166 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:46.495133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:46.560358 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:46.560325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:47.195025 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:47.194990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:53.152527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:53.152480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:53.268703 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:53.268663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:53.355517 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:35:53.355484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:03.857942 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:03.857892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:04.279373 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:04.279339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:25.271566 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:25.271536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:31.212240 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:31.212201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:31.266327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:31.266297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:31.589596 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:31.589513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:31.923435 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:31.923396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:32.367103 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:32.367072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:34.859761 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:34.859725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:34.962302 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:34.962268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:35.057948 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:35.057886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:35.176508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:35.176475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:35.496560 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:35.496474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:35.596105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:35.596072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:39.415539 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:39.415509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:39.763136 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:39.763057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:40.160487 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:40.160453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:40.374034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:40.374004    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:42.943525 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:42.943490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.042580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.042542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.098850 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.098816    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:36:43.099551 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.099404    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d29355e0-6ce7-4891-b7da-7481592fef66" containerName="main"
Jul 06 19:36:43.099551 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.099426    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d29355e0-6ce7-4891-b7da-7481592fef66" containerName="main"
Jul 06 19:36:43.099741 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.099609    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d29355e0-6ce7-4891-b7da-7481592fef66" containerName="main"
Jul 06 19:36:43.102868 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.102849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.105874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.105850    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-93827d-serving-cert\""
Jul 06 19:36:43.116207 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.116187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:36:43.144350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.144317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.144515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.144378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssn9q\" (UniqueName: \"kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.144515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.144410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.168366 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.168319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.245798 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.245712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.246009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.245808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssn9q\" (UniqueName: \"kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.246009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.245837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.246502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.246484    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.248175 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.248156    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.255182 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.255163    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssn9q\" (UniqueName: \"kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q\") pod \"maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") " pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.265219 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.265189    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.417054 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.417023    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:43.584062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.584025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.689299 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.689269    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:43.765545 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.765521    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:36:43.767294 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:36:43.767253    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3379667a_8297_4a82_a28f_eb6481d784d6.slice/crio-6b6894f5dfa5c8b18c05045c3ebc3c95b0730fdc9c7724c6808ab12913874fe8 WatchSource:0}: Error finding container 6b6894f5dfa5c8b18c05045c3ebc3c95b0730fdc9c7724c6808ab12913874fe8: Status 404 returned error can't find the container with id 6b6894f5dfa5c8b18c05045c3ebc3c95b0730fdc9c7724c6808ab12913874fe8
Jul 06 19:36:43.768690 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:43.768672    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:36:44.019997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:44.019866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:44.061654 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:44.061624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" event={"ID":"3379667a-8297-4a82-a28f-eb6481d784d6","Type":"ContainerStarted","Data":"6b6894f5dfa5c8b18c05045c3ebc3c95b0730fdc9c7724c6808ab12913874fe8"}
Jul 06 19:36:44.085564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:44.085537    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:45.068872 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:45.068840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" event={"ID":"3379667a-8297-4a82-a28f-eb6481d784d6","Type":"ContainerStarted","Data":"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"}
Jul 06 19:36:45.069274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:45.068905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:45.088991 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:45.088945    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" podStartSLOduration=1.656879155 podStartE2EDuration="2.088917609s" totalImagesPullingTime="432.038454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:45.085421846 +0000 UTC m=+1877.517679669" watchObservedRunningTime="2026-07-06 19:36:45.088917609 +0000 UTC m=+1877.521175432"
Jul 06 19:36:47.494391 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:47.494359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:51.080285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:51.080211    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:36:56.851973 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:56.851911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:56.952620 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:36:56.952583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:00.224684 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:00.224648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:05.025675 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:05.025632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:05.148350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:05.148313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:23.096150 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.096110    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:37:23.100269 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.100249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.103342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.103320    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-93827d\"/\"kube-root-ca.crt\""
Jul 06 19:37:23.104971 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.104860    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-93827d\"/\"openshift-service-ca.crt\""
Jul 06 19:37:23.105100 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.104862    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-93827d\"/\"default-dockercfg-smgqp\""
Jul 06 19:37:23.105201 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.105137    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-93827d\"/\"test-model-93827d-kserve-self-signed-certs\""
Jul 06 19:37:23.108601 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.108342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:37:23.129500 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.129474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:23.130615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.130672 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcb2v\" (UniqueName: \"kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.130718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.130761 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.130796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.130833 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.130801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231302 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231302 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcb2v\" (UniqueName: \"kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231504 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231552 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231608 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231726 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231708    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231784 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231725    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.231883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.231861    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.233743 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.233717    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.234110 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.234089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.239615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.239595    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcb2v\" (UniqueName: \"kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v\") pod \"test-model-93827d-kserve-6bb7c54c9f-g7pff\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") " pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.411610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.411578    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:23.545515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:23.545492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:37:23.547905 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:37:23.547862    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5bf3cbe_19ec_4dec_a1d6_d783cab4778a.slice/crio-59388f65a845fcb7c861abd5679e0741276fb07dd374b81312102ed1c5c5ca3d WatchSource:0}: Error finding container 59388f65a845fcb7c861abd5679e0741276fb07dd374b81312102ed1c5c5ca3d: Status 404 returned error can't find the container with id 59388f65a845fcb7c861abd5679e0741276fb07dd374b81312102ed1c5c5ca3d
Jul 06 19:37:24.279176 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:24.279139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" event={"ID":"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a","Type":"ContainerStarted","Data":"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"}
Jul 06 19:37:24.279548 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:24.279186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" event={"ID":"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a","Type":"ContainerStarted","Data":"59388f65a845fcb7c861abd5679e0741276fb07dd374b81312102ed1c5c5ca3d"}
Jul 06 19:37:24.296416 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:24.296367    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" podStartSLOduration=1.2963479 podStartE2EDuration="1.2963479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:24.296110507 +0000 UTC m=+1916.728368331" watchObservedRunningTime="2026-07-06 19:37:24.2963479 +0000 UTC m=+1916.728605726"
Jul 06 19:37:33.411721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:33.411683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:33.412269 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:33.411733    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:33.426102 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:33.426076    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:34.344199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:34.344172    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:37:41.405472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.405437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:41.780446 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.780357    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:37:41.784021 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.784004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.787064 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.787047    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-82e679-openshift-default-dockercfg-66bmb\""
Jul 06 19:37:41.795661 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.795639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:37:41.814989 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.814956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:41.911788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.911753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9g26\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.911990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.911885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.911990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.911949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.911990 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.911967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.912153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.912074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.912153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.912100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.912153 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.912135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.912259 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.912207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:41.912259 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:41.912239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013608 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9g26\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014019 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014019 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014019 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.013824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014139 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.014118    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014186 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.014166    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014222 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.014201    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014266 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.014252    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.014617 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.014600    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.016191 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.016168    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.016379 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.016362    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.022508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.022482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9g26\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.022592 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.022577    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token\") pod \"e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") " pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.094433 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.094375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:42.237062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.237034    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:37:42.238021 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:37:42.237984    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f46de43_b91c_4deb_ae0b_a9bc3a4f0d0c.slice/crio-4dad1e62550d94f3308af37219d137e2aecfebe96009426dcb177333e8ff89d5 WatchSource:0}: Error finding container 4dad1e62550d94f3308af37219d137e2aecfebe96009426dcb177333e8ff89d5: Status 404 returned error can't find the container with id 4dad1e62550d94f3308af37219d137e2aecfebe96009426dcb177333e8ff89d5
Jul 06 19:37:42.240322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.240287    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:37:42.240399 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.240351    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:37:42.240399 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.240382    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:37:42.311506 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.311472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:42.382172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.382133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerStarted","Data":"e0d640a867fdeb004eedd9ad90e2ba81d3e2e9743e86d3ba4a15f20c54941a95"}
Jul 06 19:37:42.382172 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.382204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerStarted","Data":"4dad1e62550d94f3308af37219d137e2aecfebe96009426dcb177333e8ff89d5"}
Jul 06 19:37:42.412248 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:42.412203    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podStartSLOduration=1.41218792 podStartE2EDuration="1.41218792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:42.411255163 +0000 UTC m=+1934.843512986" watchObservedRunningTime="2026-07-06 19:37:42.41218792 +0000 UTC m=+1934.844445726"
Jul 06 19:37:43.094992 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:43.094965    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:43.100526 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:43.100504    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:43.387982 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:43.387947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:43.388831 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:43.388809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:37:44.951431 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:44.951395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:45.061246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:45.061213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:45.139342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:45.139309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:45.400534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:45.400504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:45.622248 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:45.622221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:45.758456 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:45.758360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:49.737713 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:49.737678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:57.226521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:57.226487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:57.328009 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:37:57.327979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:05.013074 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:05.013043    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:06.513480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.513446    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerID="e0d640a867fdeb004eedd9ad90e2ba81d3e2e9743e86d3ba4a15f20c54941a95" exitCode=0
Jul 06 19:38:06.514042 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.513501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerDied","Data":"e0d640a867fdeb004eedd9ad90e2ba81d3e2e9743e86d3ba4a15f20c54941a95"}
Jul 06 19:38:06.514138 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.514108    2559 scope.go:117] "RemoveContainer" containerID="e0d640a867fdeb004eedd9ad90e2ba81d3e2e9743e86d3ba4a15f20c54941a95"
Jul 06 19:38:06.515413 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.515382    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:38:06.515490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.515477    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:38:06.515529 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:06.515520    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:38:07.521018 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:07.520987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerStarted","Data":"d5ae6e1f100452bff0b39bc150a8838e84e72b9db2831060ecea94a04346da22"}
Jul 06 19:38:08.095163 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:08.095130    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:38:08.095377 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:08.095351    2559 patch_prober.go:28] interesting pod/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 06 19:38:08.095461 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:08.095423    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 06 19:38:09.095251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:09.095209    2559 patch_prober.go:28] interesting pod/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 06 19:38:09.095730 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:09.095269    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 06 19:38:10.094800 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:10.094762    2559 patch_prober.go:28] interesting pod/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 06 19:38:10.095006 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:10.094822    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 06 19:38:11.095120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:11.095085    2559 patch_prober.go:28] interesting pod/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 06 19:38:11.095534 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:11.095141    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 06 19:38:12.098911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:12.098877    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:38:12.099394 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:12.099257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:38:12.099757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:12.099739    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:38:21.896906 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:21.896870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:22.291273 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:22.291171    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:22.388384 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:22.388346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:27.319521 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:27.319488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:29.800721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:29.800688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:29.901303 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:38:29.901263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:03.503307 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:03.503247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:04.256414 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:04.256367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:10.444371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.444338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:10.545477 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.545450    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:10.701745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.701663    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:39:10.701916 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.701858    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" containerID="cri-o://d5ae6e1f100452bff0b39bc150a8838e84e72b9db2831060ecea94a04346da22" gracePeriod=30
Jul 06 19:39:10.871607 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.871574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:10.989997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:10.989896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:11.923371 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:11.923338    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:12.102015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:12.101978    2559 patch_prober.go:28] interesting pod/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:39:12.102185 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:12.102036    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:39:12.893760 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:12.893731    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:39:12.928913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:12.928866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:13.360266 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:13.360183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:13.606540 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:13.606489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:13.706068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:13.706032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:13.806526 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:13.806493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:13.872269 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:13.872239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:15.911159 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:15.911123    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerID="d5ae6e1f100452bff0b39bc150a8838e84e72b9db2831060ecea94a04346da22" exitCode=0
Jul 06 19:39:15.911504 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:15.911202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerDied","Data":"d5ae6e1f100452bff0b39bc150a8838e84e72b9db2831060ecea94a04346da22"}
Jul 06 19:39:15.911504 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:15.911268    2559 scope.go:117] "RemoveContainer" containerID="e0d640a867fdeb004eedd9ad90e2ba81d3e2e9743e86d3ba4a15f20c54941a95"
Jul 06 19:39:15.971385 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:15.971321    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:39:16.008749 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.008726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.008883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.008799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.008883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.008838    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.008883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.008872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.008916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9g26\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009066 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009040    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009075    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009103    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket\") pod \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\" (UID: \"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c\") "
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009150    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009179    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009419    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009486    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-credential-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009504    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istiod-ca-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009517    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.009895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.009758    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:16.010345 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.010307    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:16.012330 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.012199    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:16.012330 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.012290    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:39:16.012330 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.012317    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:16.012552 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.012344    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26" (OuterVolumeSpecName: "kube-api-access-f9g26") pod "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" (UID: "0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c"). InnerVolumeSpecName "kube-api-access-f9g26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:16.110652 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110629    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.110652 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110651    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-data\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.110785 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110661    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9g26\" (UniqueName: \"kubernetes.io/projected/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-kube-api-access-f9g26\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.110785 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110670    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-podinfo\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.110785 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110678    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-workload-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.110785 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.110686    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c-istio-envoy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:16.918585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.918556    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"
Jul 06 19:39:16.918585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.918578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf" event={"ID":"0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c","Type":"ContainerDied","Data":"4dad1e62550d94f3308af37219d137e2aecfebe96009426dcb177333e8ff89d5"}
Jul 06 19:39:16.919074 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.918628    2559 scope.go:117] "RemoveContainer" containerID="d5ae6e1f100452bff0b39bc150a8838e84e72b9db2831060ecea94a04346da22"
Jul 06 19:39:16.939711 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.939679    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:39:16.944089 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:16.944067    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-82e679-openshift-default-6dbb555bf7-gftzf"]
Jul 06 19:39:18.143330 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:18.143294    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" path="/var/lib/kubelet/pods/0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c/volumes"
Jul 06 19:39:18.670971 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:18.670909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:27.913714 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:27.913653    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" podUID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" containerName="main" containerID="cri-o://e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d" gracePeriod=45
Jul 06 19:39:28.177375 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.177310    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:39:28.221077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221044    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcb2v\" (UniqueName: \"kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221361 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221361 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221361 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221357    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir\") pod \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\" (UID: \"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a\") "
Jul 06 19:39:28.221511 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221424    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:28.221511 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221469    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home" (OuterVolumeSpecName: "home") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:28.221686 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221664    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:28.221752 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221729    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-home\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.221807 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.221751    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-model-cache\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.223398 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.223369    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm" (OuterVolumeSpecName: "dshm") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:28.223398 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.223386    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:39:28.223540 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.223386    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v" (OuterVolumeSpecName: "kube-api-access-wcb2v") pod "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" (UID: "c5bf3cbe-19ec-4dec-a1d6-d783cab4778a"). InnerVolumeSpecName "kube-api-access-wcb2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:28.322634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.322600    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcb2v\" (UniqueName: \"kubernetes.io/projected/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-kube-api-access-wcb2v\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.322634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.322627    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tls-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.322634 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.322640    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-tmp-dir\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.322829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.322648    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a-dshm\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:28.982541 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.982499    2559 generic.go:356] "Generic (PLEG): container finished" podID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" containerID="e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d" exitCode=0
Jul 06 19:39:28.982964 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.982550    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"
Jul 06 19:39:28.982964 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.982583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" event={"ID":"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a","Type":"ContainerDied","Data":"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"}
Jul 06 19:39:28.982964 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.982631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff" event={"ID":"c5bf3cbe-19ec-4dec-a1d6-d783cab4778a","Type":"ContainerDied","Data":"59388f65a845fcb7c861abd5679e0741276fb07dd374b81312102ed1c5c5ca3d"}
Jul 06 19:39:28.982964 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.982649    2559 scope.go:117] "RemoveContainer" containerID="e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"
Jul 06 19:39:28.993810 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.993710    2559 scope.go:117] "RemoveContainer" containerID="e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"
Jul 06 19:39:28.994364 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:39:28.994342    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d\": container with ID starting with e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d not found: ID does not exist" containerID="e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"
Jul 06 19:39:28.994472 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:28.994377    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d"} err="failed to get container status \"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d\": rpc error: code = NotFound desc = could not find container \"e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d\": container with ID starting with e1e44666d91ed527a4f2de0f426df766e6f951729b8a4561883e9bdd6e3bad8d not found: ID does not exist"
Jul 06 19:39:29.006069 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:29.006047    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:39:29.009479 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:29.009456    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-93827d/test-model-93827d-kserve-6bb7c54c9f-g7pff"]
Jul 06 19:39:30.141909 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:30.141869    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" path="/var/lib/kubelet/pods/c5bf3cbe-19ec-4dec-a1d6-d783cab4778a/volumes"
Jul 06 19:39:55.490649 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:55.490575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:55.759290 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:55.759197    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:55.997282 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:55.997243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:56.161249 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.161222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:56.610078 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.610001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:56.709820 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.709792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:56.811057 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.811024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:56.861316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.861290    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:39:56.861543 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.861518    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" podUID="3379667a-8297-4a82-a28f-eb6481d784d6" containerName="maas-api" containerID="cri-o://764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1" gracePeriod=30
Jul 06 19:39:56.883850 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:56.883826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:57.117514 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.117416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:39:57.142651 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.142614    2559 generic.go:356] "Generic (PLEG): container finished" podID="3379667a-8297-4a82-a28f-eb6481d784d6" containerID="764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1" exitCode=0
Jul 06 19:39:57.142790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.142719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" event={"ID":"3379667a-8297-4a82-a28f-eb6481d784d6","Type":"ContainerDied","Data":"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"}
Jul 06 19:39:57.142855 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.142804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl" event={"ID":"3379667a-8297-4a82-a28f-eb6481d784d6","Type":"ContainerDied","Data":"6b6894f5dfa5c8b18c05045c3ebc3c95b0730fdc9c7724c6808ab12913874fe8"}
Jul 06 19:39:57.142911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.142848    2559 scope.go:117] "RemoveContainer" containerID="764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"
Jul 06 19:39:57.143324 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.143245    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"
Jul 06 19:39:57.158245 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.158226    2559 scope.go:117] "RemoveContainer" containerID="764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"
Jul 06 19:39:57.158488 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:39:57.158470    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1\": container with ID starting with 764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1 not found: ID does not exist" containerID="764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"
Jul 06 19:39:57.158558 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.158495    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1"} err="failed to get container status \"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1\": rpc error: code = NotFound desc = could not find container \"764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1\": container with ID starting with 764c71b87c230b61716ad097147a1a8f3e09a95a109f1571d49f1e22c52314b1 not found: ID does not exist"
Jul 06 19:39:57.281501 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.281476    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssn9q\" (UniqueName: \"kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q\") pod \"3379667a-8297-4a82-a28f-eb6481d784d6\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") "
Jul 06 19:39:57.281629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.281512    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls\") pod \"3379667a-8297-4a82-a28f-eb6481d784d6\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") "
Jul 06 19:39:57.281629 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.281571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca\") pod \"3379667a-8297-4a82-a28f-eb6481d784d6\" (UID: \"3379667a-8297-4a82-a28f-eb6481d784d6\") "
Jul 06 19:39:57.282080 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.282054    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3379667a-8297-4a82-a28f-eb6481d784d6" (UID: "3379667a-8297-4a82-a28f-eb6481d784d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:39:57.283553 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.283531    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3379667a-8297-4a82-a28f-eb6481d784d6" (UID: "3379667a-8297-4a82-a28f-eb6481d784d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:39:57.283635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.283565    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q" (OuterVolumeSpecName: "kube-api-access-ssn9q") pod "3379667a-8297-4a82-a28f-eb6481d784d6" (UID: "3379667a-8297-4a82-a28f-eb6481d784d6"). InnerVolumeSpecName "kube-api-access-ssn9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:57.382562 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.382509    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3379667a-8297-4a82-a28f-eb6481d784d6-openshift-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:57.382562 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.382530    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssn9q\" (UniqueName: \"kubernetes.io/projected/3379667a-8297-4a82-a28f-eb6481d784d6-kube-api-access-ssn9q\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:57.382562 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.382541    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3379667a-8297-4a82-a28f-eb6481d784d6-maas-api-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:39:57.467804 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.467772    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:39:57.470937 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:57.470905    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-93827d-67bd9d6997-nrjkl"]
Jul 06 19:39:58.142910 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:39:58.142881    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3379667a-8297-4a82-a28f-eb6481d784d6" path="/var/lib/kubelet/pods/3379667a-8297-4a82-a28f-eb6481d784d6/volumes"
Jul 06 19:40:02.446087 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:02.446056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:02.547120 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:02.547089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:02.733347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:02.733264    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:02.996655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:02.996575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:03.376177 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.376148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:03.691887 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.691813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:03.692262 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692249    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692264    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692282    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" containerName="main"
Jul 06 19:40:03.692306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692288    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" containerName="main"
Jul 06 19:40:03.692306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692296    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3379667a-8297-4a82-a28f-eb6481d784d6" containerName="maas-api"
Jul 06 19:40:03.692306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692302    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3379667a-8297-4a82-a28f-eb6481d784d6" containerName="maas-api"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692309    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692314    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692383    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692394    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f46de43-b91c-4deb-ae0b-a9bc3a4f0d0c" containerName="istio-proxy"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692401    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bf3cbe-19ec-4dec-a1d6-d783cab4778a" containerName="main"
Jul 06 19:40:03.692459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.692410    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3379667a-8297-4a82-a28f-eb6481d784d6" containerName="maas-api"
Jul 06 19:40:03.695673 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.695657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.698721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.698702    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-98bc43-openshift-default-dockercfg-4m9nc\""
Jul 06 19:40:03.711415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.711395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:03.713758 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.713732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:03.738661 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.738768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.738768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.738891 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.738891 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.739034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.739034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.738986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.739155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.739053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.739155 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.739079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840564 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840631    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.840802 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840965    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.840967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.841015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.841050    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841240 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.841061    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841240 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.841199    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.841533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.841499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.843034 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.843013    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.843151 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.843133    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.848600 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.848579    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.848968 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.848950    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr\") pod \"e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") " pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:03.902368 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:03.902341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:04.006427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.006354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:04.144427 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.144392    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:04.145834 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:40:04.145806    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce7afcb_ef56_4142_8c45_d4dedf1dd019.slice/crio-4f9b747413536bd342249e86acd411ada40f66b4bb72f07e27077353b1f92548 WatchSource:0}: Error finding container 4f9b747413536bd342249e86acd411ada40f66b4bb72f07e27077353b1f92548: Status 404 returned error can't find the container with id 4f9b747413536bd342249e86acd411ada40f66b4bb72f07e27077353b1f92548
Jul 06 19:40:04.147962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.147909    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:04.148035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.148011    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:04.148081 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.148057    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:04.180679 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:04.180655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerStarted","Data":"4f9b747413536bd342249e86acd411ada40f66b4bb72f07e27077353b1f92548"}
Jul 06 19:40:05.188449 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:05.188415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerStarted","Data":"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"}
Jul 06 19:40:05.212575 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:05.212524    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podStartSLOduration=2.212506372 podStartE2EDuration="2.212506372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:05.209037653 +0000 UTC m=+2077.641295474" watchObservedRunningTime="2026-07-06 19:40:05.212506372 +0000 UTC m=+2077.644764196"
Jul 06 19:40:06.006722 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:06.006689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:06.012388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:06.012359    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:06.193842 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:06.193808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:06.194784 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:06.194768    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:07.182631 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.182598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:07.263571 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.263522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:07.337260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.337226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:07.567654 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.567561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:07.862586 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.862559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:07.957035 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:07.956996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:11.761814 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:11.761777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:12.275916 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:12.275888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:12.601112 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:12.601023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:12.787433 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:12.787401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.063408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.063374    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.168440 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.168396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.258589 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.258549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.359720 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.359597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.761048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.761007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:15.868491 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:15.868459    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:19.652058 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:19.652023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:21.195178 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.195148    2559 patch_prober.go:28] interesting pod/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:40:21.195647 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.195216    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 19:40:21.293794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.293767    2559 generic.go:356] "Generic (PLEG): container finished" podID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerID="1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e" exitCode=0
Jul 06 19:40:21.293957 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.293841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerDied","Data":"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"}
Jul 06 19:40:21.294294 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.294279    2559 scope.go:117] "RemoveContainer" containerID="1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"
Jul 06 19:40:21.295334 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.295308    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:21.295395 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.295376    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:21.295439 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:21.295406    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 06 19:40:22.301180 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:22.301147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerStarted","Data":"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"}
Jul 06 19:40:23.006955 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:23.006908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:23.007169 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:23.007146    2559 patch_prober.go:28] interesting pod/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:40:23.007220 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:23.007194    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 19:40:24.006831 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:24.006796    2559 patch_prober.go:28] interesting pod/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:40:24.007251 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:24.006856    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 19:40:25.007293 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:25.007246    2559 patch_prober.go:28] interesting pod/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:40:25.007750 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:25.007314    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 19:40:26.007189 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:26.007153    2559 patch_prober.go:28] interesting pod/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:40:26.007382 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:26.007210    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 19:40:27.011422 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:27.011392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:27.011884 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:27.011637    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:27.012239 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:27.012225    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:28.119200 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:28.119168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:28.184680 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:28.184651    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:40:28.190902 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:28.190883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:40:29.554347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:29.554304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:34.450536 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:34.450503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:34.542568 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:34.542531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:34.745072 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:34.744991    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:34.745293 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:34.745253    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy" containerID="cri-o://2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3" gracePeriod=30
Jul 06 19:40:34.800612 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:34.800580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:35.007205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:35.007122    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:35.200724 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:35.200691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:35.677104 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:35.677074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:35.781196 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:35.781166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:35.893912 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:35.893873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:36.047296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:36.047207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:38.145295 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:38.145263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:40.007806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.007774    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:40.021885 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.021837    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.021885 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.021869    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.021896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.021941    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.021971    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022044    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022310 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022310 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022163    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data\") pod \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\" (UID: \"bce7afcb-ef56-4142-8c45-d4dedf1dd019\") "
Jul 06 19:40:40.022310 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022235    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:40.022310 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022262    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:40:40.022520 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022318    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:40.022578 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022516    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:40.022650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022633    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istiod-ca-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.022703 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022654    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-credential-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.022703 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022667    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.022703 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.022680    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-workload-socket\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.023241 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.023216    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data" (OuterVolumeSpecName: "istio-data") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:40.024263 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.024232    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr" (OuterVolumeSpecName: "kube-api-access-5cmdr") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "kube-api-access-5cmdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:40:40.024349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.024257    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token" (OuterVolumeSpecName: "istio-token") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:40:40.024349 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.024294    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:40:40.024426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.024365    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bce7afcb-ef56-4142-8c45-d4dedf1dd019" (UID: "bce7afcb-ef56-4142-8c45-d4dedf1dd019"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:40:40.123572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.123534    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-podinfo\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.123572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.123564    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-data\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.123572 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.123577    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cmdr\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-kube-api-access-5cmdr\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.123816 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.123590    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-envoy\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.123816 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.123603    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bce7afcb-ef56-4142-8c45-d4dedf1dd019-istio-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:40:40.403107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.403070    2559 generic.go:356] "Generic (PLEG): container finished" podID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerID="2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3" exitCode=0
Jul 06 19:40:40.403300 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.403122    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"
Jul 06 19:40:40.403300 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.403151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerDied","Data":"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"}
Jul 06 19:40:40.403300 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.403207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8" event={"ID":"bce7afcb-ef56-4142-8c45-d4dedf1dd019","Type":"ContainerDied","Data":"4f9b747413536bd342249e86acd411ada40f66b4bb72f07e27077353b1f92548"}
Jul 06 19:40:40.403300 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.403230    2559 scope.go:117] "RemoveContainer" containerID="2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"
Jul 06 19:40:40.414592 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.414572    2559 scope.go:117] "RemoveContainer" containerID="1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"
Jul 06 19:40:40.423781 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.423762    2559 scope.go:117] "RemoveContainer" containerID="2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"
Jul 06 19:40:40.424123 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:40:40.424096    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3\": container with ID starting with 2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3 not found: ID does not exist" containerID="2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"
Jul 06 19:40:40.424194 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.424138    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3"} err="failed to get container status \"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3\": rpc error: code = NotFound desc = could not find container \"2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3\": container with ID starting with 2b2771aa483b161e014523d8c8cd13ebfa2d04867898fb0fd132a0f5db5ecba3 not found: ID does not exist"
Jul 06 19:40:40.424194 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.424163    2559 scope.go:117] "RemoveContainer" containerID="1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"
Jul 06 19:40:40.424442 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:40:40.424423    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e\": container with ID starting with 1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e not found: ID does not exist" containerID="1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"
Jul 06 19:40:40.424485 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.424449    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e"} err="failed to get container status \"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e\": rpc error: code = NotFound desc = could not find container \"1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e\": container with ID starting with 1b4acddcfdd079329770c74728670eccf35a356844e6edfdfbf646b3f470dd8e not found: ID does not exist"
Jul 06 19:40:40.424718 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.424701    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:40.428103 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:40.428082    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-98bc43-openshift-default-6fb5cd744f-npbh8"]
Jul 06 19:40:41.350568 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:41.350536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:41.824657 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:41.824620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:41.925550 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:41.925517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:42.144404 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:42.144372    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" path="/var/lib/kubelet/pods/bce7afcb-ef56-4142-8c45-d4dedf1dd019/volumes"
Jul 06 19:40:42.334135 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:42.334104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:42.428716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:42.428626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:42.740279 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:42.740183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:43.093405 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:43.093330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:43.549242 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:43.549213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:46.283364 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.283329    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:46.384965 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.384919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:46.394255 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394228    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:40:46.394705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394692    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:40:46.394755 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394707    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:40:46.394755 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:40:46.394755 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394723    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:40:46.394856 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.394812    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:40:46.398511 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.398492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.402688 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.402665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-bd1298-serving-cert\""
Jul 06 19:40:46.412421 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.412398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:40:46.486666 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.486632    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7llh\" (UniqueName: \"kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.486839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.486695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.486839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.486722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.494388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.494363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:46.587980 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.587882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7llh\" (UniqueName: \"kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.588135 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.587996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.588135 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.588031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.588258 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:40:46.588138    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-bd1298-serving-cert: secret "maas-api-e2e-shared-a-bd1298-serving-cert" not found
Jul 06 19:40:46.588258 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:40:46.588199    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls podName:aa7d65bf-fba9-4fa2-9836-5301018c87dc nodeName:}" failed. No retries permitted until 2026-07-06 19:40:47.088183918 +0000 UTC m=+2119.520441733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls") pod "maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" (UID: "aa7d65bf-fba9-4fa2-9836-5301018c87dc") : secret "maas-api-e2e-shared-a-bd1298-serving-cert" not found
Jul 06 19:40:46.588675 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.588651    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.597329 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.597307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7llh\" (UniqueName: \"kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:46.717333 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:46.717298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:47.070731 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.070696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:47.093000 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.092967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:47.095369 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.095345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") " pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:47.209224 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.209193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:47.308847 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.308817    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:47.453111 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:47.453084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:40:47.454278 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:40:47.454253    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7d65bf_fba9_4fa2_9836_5301018c87dc.slice/crio-2e7142b3ffd977b11d9ea55cfc576e7466c094ac53415991fb020651a656fe64 WatchSource:0}: Error finding container 2e7142b3ffd977b11d9ea55cfc576e7466c094ac53415991fb020651a656fe64: Status 404 returned error can't find the container with id 2e7142b3ffd977b11d9ea55cfc576e7466c094ac53415991fb020651a656fe64
Jul 06 19:40:48.451567 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:48.451534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" event={"ID":"aa7d65bf-fba9-4fa2-9836-5301018c87dc","Type":"ContainerStarted","Data":"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"}
Jul 06 19:40:48.451983 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:48.451594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:48.451983 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:48.451615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" event={"ID":"aa7d65bf-fba9-4fa2-9836-5301018c87dc","Type":"ContainerStarted","Data":"2e7142b3ffd977b11d9ea55cfc576e7466c094ac53415991fb020651a656fe64"}
Jul 06 19:40:48.469132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:48.469087    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" podStartSLOduration=2.105097555 podStartE2EDuration="2.469071167s" totalImagesPullingTime="363.973612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:48.468181963 +0000 UTC m=+2120.900439799" watchObservedRunningTime="2026-07-06 19:40:48.469071167 +0000 UTC m=+2120.901328990"
Jul 06 19:40:50.807838 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:50.807796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:51.146571 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:51.146542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:51.470256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:51.470154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:52.200722 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:52.200692    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:54.301264 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:54.301233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:54.418151 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:54.418099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:54.461556 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:54.461526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:40:54.598036 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:54.597945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:55.085574 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:55.085548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:55.187324 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:55.187297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:55.248322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:55.248288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:59.190296 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:40:59.190259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:07.940523 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:07.940491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:08.039744 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:08.039710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:12.734533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:12.734501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:15.765884 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:15.765852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:15.866104 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:15.866074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:16.668152 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:16.668123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:35.199254 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.199221    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:41:35.200051 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.200028    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bce7afcb-ef56-4142-8c45-d4dedf1dd019" containerName="istio-proxy"
Jul 06 19:41:35.203551 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.203528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.208177 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.208151    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"kube-root-ca.crt\""
Jul 06 19:41:35.208297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.208191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"auth-test-model-f2694d-kserve-self-signed-certs\""
Jul 06 19:41:35.208297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.208222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"default-dockercfg-jjm5n\""
Jul 06 19:41:35.208297 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.208226    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"openshift-service-ca.crt\""
Jul 06 19:41:35.216713 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.216690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:41:35.278132 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.278099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:35.358597 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.358762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjdxx\" (UniqueName: \"kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.358762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.358762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.358762 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.358902 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.358798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.459794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjdxx\" (UniqueName: \"kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.459794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.459794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460077 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.459996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460335 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.460307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460404 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.460319    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.460404 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.460366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.462115 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.462094    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.462336 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.462320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.469855 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.469834    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjdxx\" (UniqueName: \"kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx\") pod \"auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") " pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.513217 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.513186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:35.652645 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.652619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:41:35.653951 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:41:35.653910    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2533901e_46a2_42a7_af35_60251913e020.slice/crio-8471fa990730099439f1fc5f1404aa2fa0b1ecaecddd2faaa5bed3b47c19bae7 WatchSource:0}: Error finding container 8471fa990730099439f1fc5f1404aa2fa0b1ecaecddd2faaa5bed3b47c19bae7: Status 404 returned error can't find the container with id 8471fa990730099439f1fc5f1404aa2fa0b1ecaecddd2faaa5bed3b47c19bae7
Jul 06 19:41:35.723089 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.723011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" event={"ID":"2533901e-46a2-42a7-af35-60251913e020","Type":"ContainerStarted","Data":"9467e4275955d3d8d29ceccceea8e9d1fd535a8e6da1c81bf1e4782a6cadc5d5"}
Jul 06 19:41:35.723089 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.723051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" event={"ID":"2533901e-46a2-42a7-af35-60251913e020","Type":"ContainerStarted","Data":"8471fa990730099439f1fc5f1404aa2fa0b1ecaecddd2faaa5bed3b47c19bae7"}
Jul 06 19:41:35.743426 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:35.743354    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" podStartSLOduration=0.743337737 podStartE2EDuration="743.337737ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:35.742469896 +0000 UTC m=+2168.174727721" watchObservedRunningTime="2026-07-06 19:41:35.743337737 +0000 UTC m=+2168.175595560"
Jul 06 19:41:45.514359 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:45.514323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:45.514809 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:45.514374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:45.526538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:45.526515    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:41:45.788699 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:41:45.788617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:42:21.883865 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:42:21.883823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:18.157139 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:18.157023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:19.107055 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:19.107021    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:43:19.149027 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:19.148996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:25.205563 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.205530    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:43:25.209318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.209301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.213941 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.213906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd1298\"/\"default-dockercfg-7glcm\""
Jul 06 19:43:25.214047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.213974    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd1298\"/\"openshift-service-ca.crt\""
Jul 06 19:43:25.214047 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.214040    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd1298\"/\"kube-root-ca.crt\""
Jul 06 19:43:25.214131 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.214099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd1298\"/\"sub-test-model-bd1298-kserve-self-signed-certs\""
Jul 06 19:43:25.220719 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.220696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:43:25.241920 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.241888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:25.299318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.299318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.299533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2v9f\" (UniqueName: \"kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.299533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.299533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.299533 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.299522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401048 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401234 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401234 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v9f\" (UniqueName: \"kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401343 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401640    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401680    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.401866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.401825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.403756 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.403623    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.404076 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.404056    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.411183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.411161    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v9f\" (UniqueName: \"kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f\") pod \"sub-test-model-bd1298-kserve-679dbbd4c9-42v56\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") " pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.519347 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.519279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:25.663111 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:25.663088    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:43:25.665259 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:43:25.665227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bb17034_9842_4cf4_bc18_c736ff37bcd5.slice/crio-cbcac2e81626afa0bd5974e6c7ff81f248e0ef8c253372741459b32dbfef3794 WatchSource:0}: Error finding container cbcac2e81626afa0bd5974e6c7ff81f248e0ef8c253372741459b32dbfef3794: Status 404 returned error can't find the container with id cbcac2e81626afa0bd5974e6c7ff81f248e0ef8c253372741459b32dbfef3794
Jul 06 19:43:26.314237 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:26.314203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" event={"ID":"5bb17034-9842-4cf4-bc18-c736ff37bcd5","Type":"ContainerStarted","Data":"83231a5608a24a8b206b03298a12420e7a582433fcb8f04f1350a8ca26f01e29"}
Jul 06 19:43:26.314632 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:26.314248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" event={"ID":"5bb17034-9842-4cf4-bc18-c736ff37bcd5","Type":"ContainerStarted","Data":"cbcac2e81626afa0bd5974e6c7ff81f248e0ef8c253372741459b32dbfef3794"}
Jul 06 19:43:26.335103 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:26.335051    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" podStartSLOduration=1.335029858 podStartE2EDuration="1.335029858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:26.333157124 +0000 UTC m=+2278.765414968" watchObservedRunningTime="2026-07-06 19:43:26.335029858 +0000 UTC m=+2278.767287682"
Jul 06 19:43:30.702632 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:30.702596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:30.803291 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:30.803258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:34.127065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.127002    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" podUID="2533901e-46a2-42a7-af35-60251913e020" containerName="main" containerID="cri-o://9467e4275955d3d8d29ceccceea8e9d1fd535a8e6da1c81bf1e4782a6cadc5d5" gracePeriod=45
Jul 06 19:43:34.362721 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.362691    2559 generic.go:356] "Generic (PLEG): container finished" podID="2533901e-46a2-42a7-af35-60251913e020" containerID="9467e4275955d3d8d29ceccceea8e9d1fd535a8e6da1c81bf1e4782a6cadc5d5" exitCode=0
Jul 06 19:43:34.362892 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.362758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" event={"ID":"2533901e-46a2-42a7-af35-60251913e020","Type":"ContainerDied","Data":"9467e4275955d3d8d29ceccceea8e9d1fd535a8e6da1c81bf1e4782a6cadc5d5"}
Jul 06 19:43:34.385469 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.385419    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:43:34.484029 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484080    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjdxx\" (UniqueName: \"kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484213    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484230    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home\") pod \"2533901e-46a2-42a7-af35-60251913e020\" (UID: \"2533901e-46a2-42a7-af35-60251913e020\") "
Jul 06 19:43:34.484471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484295    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache" (OuterVolumeSpecName: "model-cache") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:34.484471 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484347    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:34.484565 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484542    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home" (OuterVolumeSpecName: "home") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:34.484669 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484651    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-model-cache\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:34.484715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484675    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-tmp-dir\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:34.484715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.484688    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-home\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:34.486458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.486434    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:43:34.486585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.486480    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx" (OuterVolumeSpecName: "kube-api-access-bjdxx") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "kube-api-access-bjdxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:43:34.486585 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.486512    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm" (OuterVolumeSpecName: "dshm") pod "2533901e-46a2-42a7-af35-60251913e020" (UID: "2533901e-46a2-42a7-af35-60251913e020"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:43:34.586238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.586201    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjdxx\" (UniqueName: \"kubernetes.io/projected/2533901e-46a2-42a7-af35-60251913e020-kube-api-access-bjdxx\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:34.586238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.586232    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2533901e-46a2-42a7-af35-60251913e020-dshm\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:34.586238 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:34.586245    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2533901e-46a2-42a7-af35-60251913e020-tls-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:43:35.369561 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.369538    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"
Jul 06 19:43:35.370007 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.369534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml" event={"ID":"2533901e-46a2-42a7-af35-60251913e020","Type":"ContainerDied","Data":"8471fa990730099439f1fc5f1404aa2fa0b1ecaecddd2faaa5bed3b47c19bae7"}
Jul 06 19:43:35.370007 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.369661    2559 scope.go:117] "RemoveContainer" containerID="9467e4275955d3d8d29ceccceea8e9d1fd535a8e6da1c81bf1e4782a6cadc5d5"
Jul 06 19:43:35.396179 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.396147    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:43:35.401499 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.401478    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/auth-test-model-f2694d-kserve-7bfdb57c6c-l5jml"]
Jul 06 19:43:35.519784 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.519758    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:35.519962 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.519802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:35.531841 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:35.531822    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:43:36.146124 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:36.146089    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2533901e-46a2-42a7-af35-60251913e020" path="/var/lib/kubelet/pods/2533901e-46a2-42a7-af35-60251913e020/volumes"
Jul 06 19:43:36.386993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:43:36.386969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:44:05.188788 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:44:05.188737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:44:46.567913 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:44:46.567876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:44:46.583624 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:44:46.583592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:44:47.390544 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:44:47.390508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:00.144945 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.144906    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"]
Jul 06 19:45:00.145391 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.145372    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2533901e-46a2-42a7-af35-60251913e020" containerName="main"
Jul 06 19:45:00.145391 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.145387    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2533901e-46a2-42a7-af35-60251913e020" containerName="main"
Jul 06 19:45:00.145474 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.145463    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2533901e-46a2-42a7-af35-60251913e020" containerName="main"
Jul 06 19:45:00.148822 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.148807    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-jt7xd"]
Jul 06 19:45:00.148958 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.148919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:00.152191 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.152169    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"]
Jul 06 19:45:00.152318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.152278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:00.156067 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.156045    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"]
Jul 06 19:45:00.156228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.156133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:00.162805 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.162786    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"]
Jul 06 19:45:00.163866 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.163847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-jt7xd"]
Jul 06 19:45:00.263874 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.263847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h457\" (UniqueName: \"kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457\") pod \"maas-api-key-cleanup-29722785-jt7xd\" (UID: \"7e12e065-8ec7-48c7-bbda-4c0d232e45cd\") " pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:00.264016 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.263892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2mwf\" (UniqueName: \"kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf\") pod \"maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8\" (UID: \"32791eed-25a7-4be9-b3b1-bee77081fa17\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:00.264072 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.264025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wsb\" (UniqueName: \"kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb\") pod \"maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr\" (UID: \"84469585-8c0d-4a0e-9838-6c34b3bc45ce\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:00.364705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.364675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h457\" (UniqueName: \"kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457\") pod \"maas-api-key-cleanup-29722785-jt7xd\" (UID: \"7e12e065-8ec7-48c7-bbda-4c0d232e45cd\") " pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:00.364839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.364711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mwf\" (UniqueName: \"kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf\") pod \"maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8\" (UID: \"32791eed-25a7-4be9-b3b1-bee77081fa17\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:00.364839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.364773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wsb\" (UniqueName: \"kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb\") pod \"maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr\" (UID: \"84469585-8c0d-4a0e-9838-6c34b3bc45ce\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:00.375342 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.375320    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2mwf\" (UniqueName: \"kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf\") pod \"maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8\" (UID: \"32791eed-25a7-4be9-b3b1-bee77081fa17\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:00.375441 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.375403    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wsb\" (UniqueName: \"kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb\") pod \"maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr\" (UID: \"84469585-8c0d-4a0e-9838-6c34b3bc45ce\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:00.375544 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.375529    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h457\" (UniqueName: \"kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457\") pod \"maas-api-key-cleanup-29722785-jt7xd\" (UID: \"7e12e065-8ec7-48c7-bbda-4c0d232e45cd\") " pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:00.465865 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.465816    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:00.471879 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.471862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:00.478731 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.478709    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:00.831521 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:45:00.831492    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84469585_8c0d_4a0e_9838_6c34b3bc45ce.slice/crio-8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3 WatchSource:0}: Error finding container 8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3: Status 404 returned error can't find the container with id 8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3
Jul 06 19:45:00.835033 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.835006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"]
Jul 06 19:45:00.859997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.859968    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-jt7xd"]
Jul 06 19:45:00.864165 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:45:00.864129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e12e065_8ec7_48c7_bbda_4c0d232e45cd.slice/crio-fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66 WatchSource:0}: Error finding container fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66: Status 404 returned error can't find the container with id fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66
Jul 06 19:45:00.884016 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:45:00.883988    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32791eed_25a7_4be9_b3b1_bee77081fa17.slice/crio-8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac WatchSource:0}: Error finding container 8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac: Status 404 returned error can't find the container with id 8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac
Jul 06 19:45:00.886768 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:00.886740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"]
Jul 06 19:45:01.588582 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.588502    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" podUID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" containerName="main" containerID="cri-o://83231a5608a24a8b206b03298a12420e7a582433fcb8f04f1350a8ca26f01e29" gracePeriod=45
Jul 06 19:45:01.828396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.828369    2559 generic.go:356] "Generic (PLEG): container finished" podID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" containerID="83231a5608a24a8b206b03298a12420e7a582433fcb8f04f1350a8ca26f01e29" exitCode=0
Jul 06 19:45:01.828537 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.828445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" event={"ID":"5bb17034-9842-4cf4-bc18-c736ff37bcd5","Type":"ContainerDied","Data":"83231a5608a24a8b206b03298a12420e7a582433fcb8f04f1350a8ca26f01e29"}
Jul 06 19:45:01.830333 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.830304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd" event={"ID":"7e12e065-8ec7-48c7-bbda-4c0d232e45cd","Type":"ContainerStarted","Data":"fb15c0be77219c21b8ecd85097b5a80de034f8d03c770349203d950daa2da3f7"}
Jul 06 19:45:01.830459 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.830364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd" event={"ID":"7e12e065-8ec7-48c7-bbda-4c0d232e45cd","Type":"ContainerStarted","Data":"fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66"}
Jul 06 19:45:01.831976 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.831955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8" event={"ID":"32791eed-25a7-4be9-b3b1-bee77081fa17","Type":"ContainerStarted","Data":"665874b07ac9c0dc51029047c8a7a83f51a1dacf65f421b697a84955c473d9f8"}
Jul 06 19:45:01.832070 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.832015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8" event={"ID":"32791eed-25a7-4be9-b3b1-bee77081fa17","Type":"ContainerStarted","Data":"8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac"}
Jul 06 19:45:01.833676 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.833653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr" event={"ID":"84469585-8c0d-4a0e-9838-6c34b3bc45ce","Type":"ContainerStarted","Data":"8820264e35001a94e07b5eaf272138b871805273ae847aedec7d8c8b57dcec1a"}
Jul 06 19:45:01.833787 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.833697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr" event={"ID":"84469585-8c0d-4a0e-9838-6c34b3bc45ce","Type":"ContainerStarted","Data":"8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3"}
Jul 06 19:45:01.856664 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.856612    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd" podStartSLOduration=1.856592069 podStartE2EDuration="1.856592069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:01.856547565 +0000 UTC m=+2374.288805390" watchObservedRunningTime="2026-07-06 19:45:01.856592069 +0000 UTC m=+2374.288849894"
Jul 06 19:45:01.880903 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.880859    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8" podStartSLOduration=1.880844497 podStartE2EDuration="1.880844497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:01.880337015 +0000 UTC m=+2374.312594838" watchObservedRunningTime="2026-07-06 19:45:01.880844497 +0000 UTC m=+2374.313102320"
Jul 06 19:45:01.907386 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:01.907345    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr" podStartSLOduration=1.907330872 podStartE2EDuration="1.907330872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:01.906804324 +0000 UTC m=+2374.339062148" watchObservedRunningTime="2026-07-06 19:45:01.907330872 +0000 UTC m=+2374.339588736"
Jul 06 19:45:02.009073 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.009052    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:45:02.081588 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081561    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.081738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.081738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081662    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2v9f\" (UniqueName: \"kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.081738 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.081905 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081741    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.081905 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081792    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:45:02.081905 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home\") pod \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\" (UID: \"5bb17034-9842-4cf4-bc18-c736ff37bcd5\") "
Jul 06 19:45:02.082101 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.081991    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home" (OuterVolumeSpecName: "home") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:45:02.082101 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.082074    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:45:02.082262 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.082244    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-home\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.082313 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.082270    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-model-cache\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.082313 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.082285    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tmp-dir\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.083856 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.083827    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:45:02.083974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.083869    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm" (OuterVolumeSpecName: "dshm") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:45:02.083974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.083886    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f" (OuterVolumeSpecName: "kube-api-access-t2v9f") pod "5bb17034-9842-4cf4-bc18-c736ff37bcd5" (UID: "5bb17034-9842-4cf4-bc18-c736ff37bcd5"). InnerVolumeSpecName "kube-api-access-t2v9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:02.183378 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.183356    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb17034-9842-4cf4-bc18-c736ff37bcd5-dshm\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.183378 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.183376    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2v9f\" (UniqueName: \"kubernetes.io/projected/5bb17034-9842-4cf4-bc18-c736ff37bcd5-kube-api-access-t2v9f\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.183520 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.183385    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb17034-9842-4cf4-bc18-c736ff37bcd5-tls-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:02.840422 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.840389    2559 generic.go:356] "Generic (PLEG): container finished" podID="7e12e065-8ec7-48c7-bbda-4c0d232e45cd" containerID="fb15c0be77219c21b8ecd85097b5a80de034f8d03c770349203d950daa2da3f7" exitCode=0
Jul 06 19:45:02.840819 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.840468    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd" event={"ID":"7e12e065-8ec7-48c7-bbda-4c0d232e45cd","Type":"ContainerDied","Data":"fb15c0be77219c21b8ecd85097b5a80de034f8d03c770349203d950daa2da3f7"}
Jul 06 19:45:02.842010 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.841985    2559 generic.go:356] "Generic (PLEG): container finished" podID="32791eed-25a7-4be9-b3b1-bee77081fa17" containerID="665874b07ac9c0dc51029047c8a7a83f51a1dacf65f421b697a84955c473d9f8" exitCode=0
Jul 06 19:45:02.842145 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.842057    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8" event={"ID":"32791eed-25a7-4be9-b3b1-bee77081fa17","Type":"ContainerDied","Data":"665874b07ac9c0dc51029047c8a7a83f51a1dacf65f421b697a84955c473d9f8"}
Jul 06 19:45:02.843516 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.843496    2559 generic.go:356] "Generic (PLEG): container finished" podID="84469585-8c0d-4a0e-9838-6c34b3bc45ce" containerID="8820264e35001a94e07b5eaf272138b871805273ae847aedec7d8c8b57dcec1a" exitCode=0
Jul 06 19:45:02.843635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.843571    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr" event={"ID":"84469585-8c0d-4a0e-9838-6c34b3bc45ce","Type":"ContainerDied","Data":"8820264e35001a94e07b5eaf272138b871805273ae847aedec7d8c8b57dcec1a"}
Jul 06 19:45:02.844748 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.844729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56" event={"ID":"5bb17034-9842-4cf4-bc18-c736ff37bcd5","Type":"ContainerDied","Data":"cbcac2e81626afa0bd5974e6c7ff81f248e0ef8c253372741459b32dbfef3794"}
Jul 06 19:45:02.845064 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.844732    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"
Jul 06 19:45:02.845064 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.844761    2559 scope.go:117] "RemoveContainer" containerID="83231a5608a24a8b206b03298a12420e7a582433fcb8f04f1350a8ca26f01e29"
Jul 06 19:45:02.876403 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.876386    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:45:02.879642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:02.879616    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd1298/sub-test-model-bd1298-kserve-679dbbd4c9-42v56"]
Jul 06 19:45:04.010704 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.010677    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:04.014814 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.014789    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:04.067886 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.067865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:04.107482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.107417    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2mwf\" (UniqueName: \"kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf\") pod \"32791eed-25a7-4be9-b3b1-bee77081fa17\" (UID: \"32791eed-25a7-4be9-b3b1-bee77081fa17\") "
Jul 06 19:45:04.107482 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.107473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h457\" (UniqueName: \"kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457\") pod \"7e12e065-8ec7-48c7-bbda-4c0d232e45cd\" (UID: \"7e12e065-8ec7-48c7-bbda-4c0d232e45cd\") "
Jul 06 19:45:04.109544 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.109518    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf" (OuterVolumeSpecName: "kube-api-access-n2mwf") pod "32791eed-25a7-4be9-b3b1-bee77081fa17" (UID: "32791eed-25a7-4be9-b3b1-bee77081fa17"). InnerVolumeSpecName "kube-api-access-n2mwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:04.109655 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.109543    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457" (OuterVolumeSpecName: "kube-api-access-9h457") pod "7e12e065-8ec7-48c7-bbda-4c0d232e45cd" (UID: "7e12e065-8ec7-48c7-bbda-4c0d232e45cd"). InnerVolumeSpecName "kube-api-access-9h457". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:04.143453 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.143429    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" path="/var/lib/kubelet/pods/5bb17034-9842-4cf4-bc18-c736ff37bcd5/volumes"
Jul 06 19:45:04.208745 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.208723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84wsb\" (UniqueName: \"kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb\") pod \"84469585-8c0d-4a0e-9838-6c34b3bc45ce\" (UID: \"84469585-8c0d-4a0e-9838-6c34b3bc45ce\") "
Jul 06 19:45:04.209068 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.209050    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2mwf\" (UniqueName: \"kubernetes.io/projected/32791eed-25a7-4be9-b3b1-bee77081fa17-kube-api-access-n2mwf\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:04.209144 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.209075    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h457\" (UniqueName: \"kubernetes.io/projected/7e12e065-8ec7-48c7-bbda-4c0d232e45cd-kube-api-access-9h457\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:04.210570 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.210549    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb" (OuterVolumeSpecName: "kube-api-access-84wsb") pod "84469585-8c0d-4a0e-9838-6c34b3bc45ce" (UID: "84469585-8c0d-4a0e-9838-6c34b3bc45ce"). InnerVolumeSpecName "kube-api-access-84wsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:04.310179 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.310152    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84wsb\" (UniqueName: \"kubernetes.io/projected/84469585-8c0d-4a0e-9838-6c34b3bc45ce-kube-api-access-84wsb\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:45:04.858838 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.858814    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd"
Jul 06 19:45:04.859060 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.858817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-jt7xd" event={"ID":"7e12e065-8ec7-48c7-bbda-4c0d232e45cd","Type":"ContainerDied","Data":"fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66"}
Jul 06 19:45:04.859060 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.858950    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdee4911dd6a5b90acb51707a4e91a215d7848755aeb54075340ebd2877d8b66"
Jul 06 19:45:04.860156 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.860135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8" event={"ID":"32791eed-25a7-4be9-b3b1-bee77081fa17","Type":"ContainerDied","Data":"8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac"}
Jul 06 19:45:04.860274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.860174    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a58144d4084ed991e3797e2ad56f3346cb20f810edac29aba1eefb6473ba3ac"
Jul 06 19:45:04.860274 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.860138    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"
Jul 06 19:45:04.861458 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.861441    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"
Jul 06 19:45:04.861551 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.861484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr" event={"ID":"84469585-8c0d-4a0e-9838-6c34b3bc45ce","Type":"ContainerDied","Data":"8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3"}
Jul 06 19:45:04.861551 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:04.861522    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d1a045e275bf31d2ed012dd1728e24e5445141254f200136f236fe8dab43ea3"
Jul 06 19:45:07.218833 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:07.218801    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:28.220920 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:28.220887    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:45:28.227940 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:28.227904    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfhdm_e855130e-1155-4a6e-97a4-dee6a80c2a37/ovn-acl-logging/0.log"
Jul 06 19:45:45.993645 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.993609    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:45:45.994365 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994342    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84469585-8c0d-4a0e-9838-6c34b3bc45ce" containerName="cleanup"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994368    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84469585-8c0d-4a0e-9838-6c34b3bc45ce" containerName="cleanup"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994384    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" containerName="main"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994390    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" containerName="main"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994398    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e12e065-8ec7-48c7-bbda-4c0d232e45cd" containerName="cleanup"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994404    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e12e065-8ec7-48c7-bbda-4c0d232e45cd" containerName="cleanup"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994417    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32791eed-25a7-4be9-b3b1-bee77081fa17" containerName="cleanup"
Jul 06 19:45:45.994480 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994423    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="32791eed-25a7-4be9-b3b1-bee77081fa17" containerName="cleanup"
Jul 06 19:45:45.994911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994507    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e12e065-8ec7-48c7-bbda-4c0d232e45cd" containerName="cleanup"
Jul 06 19:45:45.994911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994518    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84469585-8c0d-4a0e-9838-6c34b3bc45ce" containerName="cleanup"
Jul 06 19:45:45.994911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994526    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="32791eed-25a7-4be9-b3b1-bee77081fa17" containerName="cleanup"
Jul 06 19:45:45.994911 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.994535    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb17034-9842-4cf4-bc18-c736ff37bcd5" containerName="main"
Jul 06 19:45:45.998279 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:45.998257    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.001228 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.001206    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"openshift-service-ca.crt\""
Jul 06 19:45:46.002773 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.002749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"kube-root-ca.crt\""
Jul 06 19:45:46.002899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.002814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"rate-test-model-f2694d-kserve-self-signed-certs\""
Jul 06 19:45:46.002899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.002836    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f2694d\"/\"default-dockercfg-jjm5n\""
Jul 06 19:45:46.009700 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.009680    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:45:46.033246 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.033206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:46.092095 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.092232 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.092232 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.092232 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.092340 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.092340 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.092268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdwbg\" (UniqueName: \"kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193358 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdwbg\" (UniqueName: \"kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193735 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193695    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.193794 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.193697    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.194046 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.194030    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.195853 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.195824    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.195972 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.195913    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.201621 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.201604    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdwbg\" (UniqueName: \"kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg\") pod \"rate-test-model-f2694d-kserve-7dc8b87595-qd52h\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") " pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.310678 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.310616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:46.451723 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:46.451695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:45:46.452896 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:45:46.452872    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod897b45fb_54c7_45d9_b8da_806a75c13cac.slice/crio-b279644fe6e0858bac710c56c5f8e806bd1aeecaf9b18e60864ef435308680c4 WatchSource:0}: Error finding container b279644fe6e0858bac710c56c5f8e806bd1aeecaf9b18e60864ef435308680c4: Status 404 returned error can't find the container with id b279644fe6e0858bac710c56c5f8e806bd1aeecaf9b18e60864ef435308680c4
Jul 06 19:45:47.097226 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:47.097188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" event={"ID":"897b45fb-54c7-45d9-b8da-806a75c13cac","Type":"ContainerStarted","Data":"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"}
Jul 06 19:45:47.097226 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:47.097231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" event={"ID":"897b45fb-54c7-45d9-b8da-806a75c13cac","Type":"ContainerStarted","Data":"b279644fe6e0858bac710c56c5f8e806bd1aeecaf9b18e60864ef435308680c4"}
Jul 06 19:45:47.118061 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:47.118015    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" podStartSLOduration=2.117998253 podStartE2EDuration="2.117998253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:47.117437163 +0000 UTC m=+2419.549695034" watchObservedRunningTime="2026-07-06 19:45:47.117998253 +0000 UTC m=+2419.550256078"
Jul 06 19:45:56.311179 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:56.311090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:56.311179 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:56.311133    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:56.323720 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:56.323697    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:45:57.163388 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:45:57.163359    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:46:08.841951 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:08.841901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:08.941857 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:08.941826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:16.489131 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:16.489097    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:16.632257 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:16.632217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:30.061790 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:30.061753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:30.809825 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:30.809785    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:46:30.829632 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:30.829603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:32.237197 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:32.237157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:36.691260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:36.691210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.087214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.087104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.186528 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.186484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.292514 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.292463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.406285 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.406244    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:46:37.406580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.406532    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" podUID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" containerName="maas-api" containerID="cri-o://edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80" gracePeriod=30
Jul 06 19:46:37.439329 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.439274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.440276 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.440254    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"]
Jul 06 19:46:37.442557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.442536    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bd1298-29722785-xshjr"]
Jul 06 19:46:37.668327 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.668272    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:46:37.768318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.768288    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca\") pod \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") "
Jul 06 19:46:37.768318 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.768320    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") pod \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") "
Jul 06 19:46:37.768739 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.768380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7llh\" (UniqueName: \"kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh\") pod \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\" (UID: \"aa7d65bf-fba9-4fa2-9836-5301018c87dc\") "
Jul 06 19:46:37.768739 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.768667    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa7d65bf-fba9-4fa2-9836-5301018c87dc" (UID: "aa7d65bf-fba9-4fa2-9836-5301018c87dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:37.770403 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.770382    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa7d65bf-fba9-4fa2-9836-5301018c87dc" (UID: "aa7d65bf-fba9-4fa2-9836-5301018c87dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:37.770500 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.770434    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh" (OuterVolumeSpecName: "kube-api-access-f7llh") pod "aa7d65bf-fba9-4fa2-9836-5301018c87dc" (UID: "aa7d65bf-fba9-4fa2-9836-5301018c87dc"). InnerVolumeSpecName "kube-api-access-f7llh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:37.869839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.869805    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7llh\" (UniqueName: \"kubernetes.io/projected/aa7d65bf-fba9-4fa2-9836-5301018c87dc-kube-api-access-f7llh\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:37.869839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.869834    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7d65bf-fba9-4fa2-9836-5301018c87dc-openshift-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:37.869839 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:37.869844    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa7d65bf-fba9-4fa2-9836-5301018c87dc-maas-api-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:38.149508 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.149473    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84469585-8c0d-4a0e-9838-6c34b3bc45ce" path="/var/lib/kubelet/pods/84469585-8c0d-4a0e-9838-6c34b3bc45ce/volumes"
Jul 06 19:46:38.375650 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.375614    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" containerID="edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80" exitCode=0
Jul 06 19:46:38.375806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.375674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" event={"ID":"aa7d65bf-fba9-4fa2-9836-5301018c87dc","Type":"ContainerDied","Data":"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"}
Jul 06 19:46:38.375806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.375718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5" event={"ID":"aa7d65bf-fba9-4fa2-9836-5301018c87dc","Type":"ContainerDied","Data":"2e7142b3ffd977b11d9ea55cfc576e7466c094ac53415991fb020651a656fe64"}
Jul 06 19:46:38.375806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.375741    2559 scope.go:117] "RemoveContainer" containerID="edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"
Jul 06 19:46:38.375806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.375673    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"
Jul 06 19:46:38.384728 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.384710    2559 scope.go:117] "RemoveContainer" containerID="edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"
Jul 06 19:46:38.384993 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:46:38.384973    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80\": container with ID starting with edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80 not found: ID does not exist" containerID="edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"
Jul 06 19:46:38.385065 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.385004    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80"} err="failed to get container status \"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80\": rpc error: code = NotFound desc = could not find container \"edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80\": container with ID starting with edfaec556a55a54487d5fee7d55f4d93724da2faea5bf8ae00948362eb1fbc80 not found: ID does not exist"
Jul 06 19:46:38.394284 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.394261    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:46:38.399753 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:38.399699    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bd1298-6b567c665f-b5bk5"]
Jul 06 19:46:40.142687 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:40.142653    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" path="/var/lib/kubelet/pods/aa7d65bf-fba9-4fa2-9836-5301018c87dc/volumes"
Jul 06 19:46:42.161642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:42.161603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:45.829838 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:45.829803    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" podUID="897b45fb-54c7-45d9-b8da-806a75c13cac" containerName="main" containerID="cri-o://b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189" gracePeriod=45
Jul 06 19:46:46.077090 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.077063    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:46:46.250548 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250524    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250567    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250599    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250622    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250716 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250966 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdwbg\" (UniqueName: \"kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg\") pod \"897b45fb-54c7-45d9-b8da-806a75c13cac\" (UID: \"897b45fb-54c7-45d9-b8da-806a75c13cac\") "
Jul 06 19:46:46.250966 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250790    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache" (OuterVolumeSpecName: "model-cache") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:46.250966 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250943    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home" (OuterVolumeSpecName: "home") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:46.251105 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.250977    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:46.251173 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.251155    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-home\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.251231 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.251181    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-tmp-dir\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.251231 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.251196    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-model-cache\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.252642 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.252621    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm" (OuterVolumeSpecName: "dshm") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:46.252816 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.252797    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg" (OuterVolumeSpecName: "kube-api-access-fdwbg") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "kube-api-access-fdwbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:46.252889 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.252874    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "897b45fb-54c7-45d9-b8da-806a75c13cac" (UID: "897b45fb-54c7-45d9-b8da-806a75c13cac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:46.351829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.351801    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/897b45fb-54c7-45d9-b8da-806a75c13cac-dshm\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.351829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.351823    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/897b45fb-54c7-45d9-b8da-806a75c13cac-tls-certs\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.351829 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.351834    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdwbg\" (UniqueName: \"kubernetes.io/projected/897b45fb-54c7-45d9-b8da-806a75c13cac-kube-api-access-fdwbg\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.422271 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.422240    2559 generic.go:356] "Generic (PLEG): container finished" podID="897b45fb-54c7-45d9-b8da-806a75c13cac" containerID="b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189" exitCode=0
Jul 06 19:46:46.422396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.422283    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"
Jul 06 19:46:46.422396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.422316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" event={"ID":"897b45fb-54c7-45d9-b8da-806a75c13cac","Type":"ContainerDied","Data":"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"}
Jul 06 19:46:46.422396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.422356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h" event={"ID":"897b45fb-54c7-45d9-b8da-806a75c13cac","Type":"ContainerDied","Data":"b279644fe6e0858bac710c56c5f8e806bd1aeecaf9b18e60864ef435308680c4"}
Jul 06 19:46:46.422396 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.422373    2559 scope.go:117] "RemoveContainer" containerID="b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"
Jul 06 19:46:46.431715 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.431696    2559 scope.go:117] "RemoveContainer" containerID="b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"
Jul 06 19:46:46.432055 ip-10-0-134-25 kubenswrapper[2559]: E0706 19:46:46.432035    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189\": container with ID starting with b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189 not found: ID does not exist" containerID="b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"
Jul 06 19:46:46.432134 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.432067    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189"} err="failed to get container status \"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189\": rpc error: code = NotFound desc = could not find container \"b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189\": container with ID starting with b6d0537812e0f696d90e72b1b2c18e039e4668a11ae95d0c5e076354d971a189 not found: ID does not exist"
Jul 06 19:46:46.449918 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.449891    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:46:46.453786 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:46.453764    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f2694d/rate-test-model-f2694d-kserve-7dc8b87595-qd52h"]
Jul 06 19:46:48.143743 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:48.143710    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897b45fb-54c7-45d9-b8da-806a75c13cac" path="/var/lib/kubelet/pods/897b45fb-54c7-45d9-b8da-806a75c13cac/volumes"
Jul 06 19:46:48.265316 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:48.265286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:48.555359 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:48.555276    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:48.844449 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:48.844361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:48.980075 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:48.980042    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:49.416974 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:49.416947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:49.521949 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:49.521898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:49.670059 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:49.669986    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"]
Jul 06 19:46:49.673320 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:49.673296    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f2694d-29722785-6m5q8"]
Jul 06 19:46:49.679151 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:49.679113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:50.142705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:50.142672    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32791eed-25a7-4be9-b3b1-bee77081fa17" path="/var/lib/kubelet/pods/32791eed-25a7-4be9-b3b1-bee77081fa17/volumes"
Jul 06 19:46:55.259465 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:55.259435    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:55.336112 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:55.336052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:55.545796 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:55.545718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:55.777321 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:46:55.777290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:00.939849 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:00.939806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9rxx8_eeb2f0cf-2d02-4212-b7d6-00d283970ef5/manager/0.log"
Jul 06 19:47:01.062776 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.062747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g82dp_78e1d0d2-8215-4ecd-bfda-e2c20a48e013/manager/0.log"
Jul 06 19:47:01.180812 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.180782    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86db469997-5zlwj_d45c146f-6baf-480c-aef4-729ae8a3da25/maas-api/0.log"
Jul 06 19:47:01.290814 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.290747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722755-4x5tj_def405cc-c090-4b8e-8803-2aa35ec8b172/cleanup/0.log"
Jul 06 19:47:01.405138 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.405113    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-27t8r_5fb7e388-0f23-42ab-aab4-39e5d769bf66/cleanup/0.log"
Jul 06 19:47:01.517017 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.516994    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-jt7xd_7e12e065-8ec7-48c7-bbda-4c0d232e45cd/cleanup/0.log"
Jul 06 19:47:01.637205 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.637177    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fcff6bdb8-sdcmg_f3b08083-eb61-415d-b78d-e65cc441c724/manager/0.log"
Jul 06 19:47:01.754390 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.754368    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4xql6_3f9d0d4c-58ef-4785-8675-5518a7dd2503/server/0.log"
Jul 06 19:47:01.874515 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:01.874478    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jgrgq_e19b169b-f1e8-4f87-88f8-dd32b20043c0/manager/0.log"
Jul 06 19:47:02.264657 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:02.264632    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn_d7d67f66-2134-44c1-b694-727a94ce301b/copy-manifests/0.log"
Jul 06 19:47:02.270024 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:02.269992    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn_d7d67f66-2134-44c1-b694-727a94ce301b/manager/0.log"
Jul 06 19:47:02.382493 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:02.382470    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-v765f_497a279c-2634-4b79-ad52-94153cf128ff/postgres/0.log"
Jul 06 19:47:03.842559 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:03.842532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9rvw5_2c0dbe84-4e77-4dac-819c-23b4061f2acd/manager/0.log"
Jul 06 19:47:03.960538 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:03.960512    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4kjk_c84a26c9-b178-48be-9164-eb6fb58786c2/manager/0.log"
Jul 06 19:47:04.194057 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:04.194032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gc894_bca70ce6-acac-4974-86dd-b89d036f2cf0/registry-server/0.log"
Jul 06 19:47:04.563939 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:04.563849    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kfmdw_12db7936-1058-46cb-ba97-d3953fa8a5a5/manager/0.log"
Jul 06 19:47:04.935423 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:04.935364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47r54q_759f224f-d6cf-49ca-8c0d-d131c466d457/istio-proxy/0.log"
Jul 06 19:47:05.297779 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:05.297683    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b9884b5-lkmf2_d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5/kube-auth-proxy/0.log"
Jul 06 19:47:05.421867 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:05.421842    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/1.log"
Jul 06 19:47:05.539747 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:05.539713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85wvp_8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb/payload-pre-processing/0.log"
Jul 06 19:47:05.658635 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:05.658601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cj9rx_5b9cb0c6-a3e1-4da6-943c-a30d21a7978d/payload-processing/0.log"
Jul 06 19:47:06.152023 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:06.151996    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5l8v4_937d06ab-1b50-4101-a978-2e7763ba1dcf/main/0.log"
Jul 06 19:47:06.512475 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:06.512402    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzs9lk_15113697-81cb-4a5b-8f10-4110f557a8ee/main/0.log"
Jul 06 19:47:11.332306 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332281    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-976df/must-gather-bs9sp"]
Jul 06 19:47:11.332763 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332682    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" containerName="maas-api"
Jul 06 19:47:11.332763 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332693    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" containerName="maas-api"
Jul 06 19:47:11.332763 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332717    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897b45fb-54c7-45d9-b8da-806a75c13cac" containerName="main"
Jul 06 19:47:11.332763 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332722    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="897b45fb-54c7-45d9-b8da-806a75c13cac" containerName="main"
Jul 06 19:47:11.332895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332782    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="897b45fb-54c7-45d9-b8da-806a75c13cac" containerName="main"
Jul 06 19:47:11.332895 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.332794    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7d65bf-fba9-4fa2-9836-5301018c87dc" containerName="maas-api"
Jul 06 19:47:11.336038 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.336022    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.339212 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.339191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-976df\"/\"default-dockercfg-dhsqh\""
Jul 06 19:47:11.340420 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.340402    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-976df\"/\"openshift-service-ca.crt\""
Jul 06 19:47:11.340524 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.340446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-976df\"/\"kube-root-ca.crt\""
Jul 06 19:47:11.348971 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.348951    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/must-gather-bs9sp"]
Jul 06 19:47:11.351405 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.351370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:11.449416 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.449394    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:11.471772 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.471748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c39eb2a1-c327-453a-84fe-18df9a606185-must-gather-output\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.471859 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.471794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8fx\" (UniqueName: \"kubernetes.io/projected/c39eb2a1-c327-453a-84fe-18df9a606185-kube-api-access-dx8fx\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.572717 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.572694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c39eb2a1-c327-453a-84fe-18df9a606185-must-gather-output\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.572830 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.572738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8fx\" (UniqueName: \"kubernetes.io/projected/c39eb2a1-c327-453a-84fe-18df9a606185-kube-api-access-dx8fx\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.573083 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.573065    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c39eb2a1-c327-453a-84fe-18df9a606185-must-gather-output\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.583256 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.583207    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8fx\" (UniqueName: \"kubernetes.io/projected/c39eb2a1-c327-453a-84fe-18df9a606185-kube-api-access-dx8fx\") pod \"must-gather-bs9sp\" (UID: \"c39eb2a1-c327-453a-84fe-18df9a606185\") " pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.645229 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.645206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/must-gather-bs9sp"
Jul 06 19:47:11.778892 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.778837    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/must-gather-bs9sp"]
Jul 06 19:47:11.781173 ip-10-0-134-25 kubenswrapper[2559]: W0706 19:47:11.781145    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc39eb2a1_c327_453a_84fe_18df9a606185.slice/crio-10426cac479fb5de45974470f2f5d55a9205c6030303deca7a9b1cd17d989727 WatchSource:0}: Error finding container 10426cac479fb5de45974470f2f5d55a9205c6030303deca7a9b1cd17d989727: Status 404 returned error can't find the container with id 10426cac479fb5de45974470f2f5d55a9205c6030303deca7a9b1cd17d989727
Jul 06 19:47:11.782899 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:11.782884    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:47:12.563580 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:12.563539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/must-gather-bs9sp" event={"ID":"c39eb2a1-c327-453a-84fe-18df9a606185","Type":"ContainerStarted","Data":"10426cac479fb5de45974470f2f5d55a9205c6030303deca7a9b1cd17d989727"}
Jul 06 19:47:13.574997 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:13.574960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/must-gather-bs9sp" event={"ID":"c39eb2a1-c327-453a-84fe-18df9a606185","Type":"ContainerStarted","Data":"90feb910b4710ba6179ffded36dd75ac05978d401640fb29bb234e08eca11c39"}
Jul 06 19:47:13.575543 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:13.575014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/must-gather-bs9sp" event={"ID":"c39eb2a1-c327-453a-84fe-18df9a606185","Type":"ContainerStarted","Data":"18f76ee0a6542cd0ffcc0eaddd01d7ad6e88c70d739702da1f068cc4f5f1c678"}
Jul 06 19:47:13.592904 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:13.592857    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-976df/must-gather-bs9sp" podStartSLOduration=1.707312714 podStartE2EDuration="2.592840796s" totalImagesPullingTime="885.528082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:47:13.590950323 +0000 UTC m=+2506.023208148" watchObservedRunningTime="2026-07-06 19:47:13.592840796 +0000 UTC m=+2506.025098645"
Jul 06 19:47:14.223883 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:14.223840    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rzt79_0e33cb85-d1d4-4f9e-be27-7edb6984fbb3/global-pull-secret-syncer/0.log"
Jul 06 19:47:14.270160 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:14.270125    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bcrgx_4ef25f62-ab39-45e9-8c93-17c4f449f76a/konnectivity-agent/0.log"
Jul 06 19:47:14.370511 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:14.370476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-25.ec2.internal_65902c972529daec087ce8445b0d59a7/haproxy/0.log"
Jul 06 19:47:20.079423 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:20.079394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9rvw5_2c0dbe84-4e77-4dac-819c-23b4061f2acd/manager/0.log"
Jul 06 19:47:20.131143 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:20.131117    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4kjk_c84a26c9-b178-48be-9164-eb6fb58786c2/manager/0.log"
Jul 06 19:47:20.220877 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:20.220844    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gc894_bca70ce6-acac-4974-86dd-b89d036f2cf0/registry-server/0.log"
Jul 06 19:47:20.520993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:20.520957    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kfmdw_12db7936-1058-46cb-ba97-d3953fa8a5a5/manager/0.log"
Jul 06 19:47:22.376394 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.376302    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mdsjl_28721649-2582-4cd5-96d7-c7ee50f830be/kube-state-metrics/0.log"
Jul 06 19:47:22.404107 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.404076    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mdsjl_28721649-2582-4cd5-96d7-c7ee50f830be/kube-rbac-proxy-main/0.log"
Jul 06 19:47:22.430322 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.430294    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mdsjl_28721649-2582-4cd5-96d7-c7ee50f830be/kube-rbac-proxy-self/0.log"
Jul 06 19:47:22.457062 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.457032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5df74ffdf4-sdzdr_33c811c7-7231-4eba-96cd-6f9f62cf0da5/metrics-server/0.log"
Jul 06 19:47:22.483309 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.483280    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-f9bw9_3ed2e506-da08-4cae-98fc-e07d746b1713/monitoring-plugin/0.log"
Jul 06 19:47:22.648628 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.648555    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slqsq_b0e347ee-189d-4298-bf8e-1ae63ee37e64/node-exporter/0.log"
Jul 06 19:47:22.667961 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.667915    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slqsq_b0e347ee-189d-4298-bf8e-1ae63ee37e64/kube-rbac-proxy/0.log"
Jul 06 19:47:22.696431 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.696391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slqsq_b0e347ee-189d-4298-bf8e-1ae63ee37e64/init-textfile/0.log"
Jul 06 19:47:22.720797 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.720773    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5qqpd_2d015adb-b261-4cdf-a0b7-750890dd1098/kube-rbac-proxy-main/0.log"
Jul 06 19:47:22.740015 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.739989    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5qqpd_2d015adb-b261-4cdf-a0b7-750890dd1098/kube-rbac-proxy-self/0.log"
Jul 06 19:47:22.766182 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.766129    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5qqpd_2d015adb-b261-4cdf-a0b7-750890dd1098/openshift-state-metrics/0.log"
Jul 06 19:47:22.799279 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.799249    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/prometheus/0.log"
Jul 06 19:47:22.817579 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.817555    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/config-reloader/0.log"
Jul 06 19:47:22.840224 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.840201    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/thanos-sidecar/0.log"
Jul 06 19:47:22.859530 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.859506    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/kube-rbac-proxy-web/0.log"
Jul 06 19:47:22.879432 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.879408    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/kube-rbac-proxy/0.log"
Jul 06 19:47:22.901183 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.901108    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/kube-rbac-proxy-thanos/0.log"
Jul 06 19:47:22.921502 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.921477    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e553fb87-73c1-4d5f-9c02-80b280f51cf6/init-config-reloader/0.log"
Jul 06 19:47:22.953206 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.953169    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-khwbf_ce78a006-8dda-48f8-866c-2abcee998304/prometheus-operator/0.log"
Jul 06 19:47:22.970815 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.970761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-khwbf_ce78a006-8dda-48f8-866c-2abcee998304/kube-rbac-proxy/0.log"
Jul 06 19:47:22.993667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:22.993636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-cjfst_376367bf-a9f0-46f0-90fb-3c1952560070/prometheus-operator-admission-webhook/0.log"
Jul 06 19:47:23.092237 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.092211    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/thanos-query/0.log"
Jul 06 19:47:23.114667 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.114636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/kube-rbac-proxy-web/0.log"
Jul 06 19:47:23.134076 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.134051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/kube-rbac-proxy/0.log"
Jul 06 19:47:23.159083 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.159002    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/prom-label-proxy/0.log"
Jul 06 19:47:23.177240 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.177211    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/kube-rbac-proxy-rules/0.log"
Jul 06 19:47:23.196148 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.196120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-758fb67fc4-trpmj_c57baaf2-f843-47eb-a721-8b56af01fe54/kube-rbac-proxy-metrics/0.log"
Jul 06 19:47:23.897750 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.897704    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"]
Jul 06 19:47:23.903039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.903014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:23.909020 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:23.908993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"]
Jul 06 19:47:24.013736 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.013677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-podres\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.013948 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.013754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-sys\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.013948 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.013832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-proc\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.013948 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.013857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr28l\" (UniqueName: \"kubernetes.io/projected/9dad04fb-5cb0-432c-b125-757cfb58a7ff-kube-api-access-kr28l\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.013948 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.013885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-lib-modules\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.115415 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.115367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-proc\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.115675 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.115656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr28l\" (UniqueName: \"kubernetes.io/projected/9dad04fb-5cb0-432c-b125-757cfb58a7ff-kube-api-access-kr28l\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.115814 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.115801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-lib-modules\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.116017    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-lib-modules\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.116049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-podres\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.116121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-sys\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.116135    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-podres\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116187 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.115513    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-proc\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.116542 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.116248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dad04fb-5cb0-432c-b125-757cfb58a7ff-sys\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.124978 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.124956    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr28l\" (UniqueName: \"kubernetes.io/projected/9dad04fb-5cb0-432c-b125-757cfb58a7ff-kube-api-access-kr28l\") pod \"perf-node-gather-daemonset-tgk7r\" (UID: \"9dad04fb-5cb0-432c-b125-757cfb58a7ff\") " pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.224443 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.224353    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.422260 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.421966    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"]
Jul 06 19:47:24.702691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.701702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r" event={"ID":"9dad04fb-5cb0-432c-b125-757cfb58a7ff","Type":"ContainerStarted","Data":"1c12bcb09b7bea7389557609b87d91b4dbfb6507af853c4723759da174c1f07c"}
Jul 06 19:47:24.702691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.701768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r" event={"ID":"9dad04fb-5cb0-432c-b125-757cfb58a7ff","Type":"ContainerStarted","Data":"0671a847a3c23e305b4b5f1e0c10c1d332212945a3c8aee2b599de41c55237bb"}
Jul 06 19:47:24.702691 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.702690    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:24.718847 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:24.718785    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r" podStartSLOduration=1.718765796 podStartE2EDuration="1.718765796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:47:24.71798915 +0000 UTC m=+2517.150246975" watchObservedRunningTime="2026-07-06 19:47:24.718765796 +0000 UTC m=+2517.151023622"
Jul 06 19:47:26.914223 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:26.914195    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvd7f_526c6187-ef19-467b-812f-152bddb60ddb/dns/0.log"
Jul 06 19:47:26.932527 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:26.932504    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zvd7f_526c6187-ef19-467b-812f-152bddb60ddb/kube-rbac-proxy/0.log"
Jul 06 19:47:26.972631 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:26.972602    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-htwtx_a31ed6f1-ba57-4a5d-b836-8001188f47aa/dns-node-resolver/0.log"
Jul 06 19:47:27.538615 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:27.538581    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-846d9ff779-jvhjf_aefce113-82ea-4588-b363-2554df4572ba/registry/0.log"
Jul 06 19:47:27.577151 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:27.577125    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdcth_894f72ac-3300-45c3-ae67-92fba9f94098/node-ca/0.log"
Jul 06 19:47:28.481358 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.481283    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47r54q_759f224f-d6cf-49ca-8c0d-d131c466d457/istio-proxy/0.log"
Jul 06 19:47:28.743549 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.743475    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b9884b5-lkmf2_d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5/kube-auth-proxy/0.log"
Jul 06 19:47:28.773726 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.773697    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/0.log"
Jul 06 19:47:28.813061 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.813029    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/1.log"
Jul 06 19:47:28.850039 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.850012    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85wvp_8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb/payload-pre-processing/0.log"
Jul 06 19:47:28.902125 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:28.902091    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cj9rx_5b9cb0c6-a3e1-4da6-943c-a30d21a7978d/payload-processing/0.log"
Jul 06 19:47:29.570751 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:29.570722    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckhgv_f85e50e9-94b1-411d-981d-06e349345c23/serve-healthcheck-canary/0.log"
Jul 06 19:47:30.201168 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:30.201139    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9w64_9d904744-185e-41d8-bbe1-4ec67af6da71/kube-rbac-proxy/0.log"
Jul 06 19:47:30.219293 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:30.219264    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9w64_9d904744-185e-41d8-bbe1-4ec67af6da71/exporter/0.log"
Jul 06 19:47:30.238408 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:30.238371    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9w64_9d904744-185e-41d8-bbe1-4ec67af6da71/extractor/0.log"
Jul 06 19:47:31.729350 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:31.729323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-976df/perf-node-gather-daemonset-tgk7r"
Jul 06 19:47:32.350993 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.350961    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9rxx8_eeb2f0cf-2d02-4212-b7d6-00d283970ef5/manager/0.log"
Jul 06 19:47:32.545757 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.545729    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g82dp_78e1d0d2-8215-4ecd-bfda-e2c20a48e013/manager/0.log"
Jul 06 19:47:32.586805 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.586777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-86db469997-5zlwj_d45c146f-6baf-480c-aef4-729ae8a3da25/maas-api/0.log"
Jul 06 19:47:32.607315 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.607242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722755-4x5tj_def405cc-c090-4b8e-8803-2aa35ec8b172/cleanup/0.log"
Jul 06 19:47:32.630540 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.630511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-27t8r_5fb7e388-0f23-42ab-aab4-39e5d769bf66/cleanup/0.log"
Jul 06 19:47:32.651770 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.651741    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-jt7xd_7e12e065-8ec7-48c7-bbda-4c0d232e45cd/cleanup/0.log"
Jul 06 19:47:32.810298 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.809829    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6fcff6bdb8-sdcmg_f3b08083-eb61-415d-b78d-e65cc441c724/manager/0.log"
Jul 06 19:47:32.830456 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.830419    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4xql6_3f9d0d4c-58ef-4785-8675-5518a7dd2503/server/0.log"
Jul 06 19:47:32.916510 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:32.916477    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jgrgq_e19b169b-f1e8-4f87-88f8-dd32b20043c0/manager/0.log"
Jul 06 19:47:33.079543 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:33.079515    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn_d7d67f66-2134-44c1-b694-727a94ce301b/manager/0.log"
Jul 06 19:47:33.101005 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:33.100975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4cdfbd4d-nlgqn_d7d67f66-2134-44c1-b694-727a94ce301b/copy-manifests/0.log"
Jul 06 19:47:33.123806 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:33.123764    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-v765f_497a279c-2634-4b79-ad52-94153cf128ff/postgres/0.log"
Jul 06 19:47:34.644383 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.644354    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lzfzv_c2aaa989-d930-4849-a6d1-4d4b921773ba/openshift-lws-operator/0.log"
Jul 06 19:47:34.658490 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.658461    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47r54q_759f224f-d6cf-49ca-8c0d-d131c466d457/istio-proxy/0.log"
Jul 06 19:47:34.888705 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.888680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b9884b5-lkmf2_d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5/kube-auth-proxy/0.log"
Jul 06 19:47:34.907177 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.907078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/0.log"
Jul 06 19:47:34.946194 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.946158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/1.log"
Jul 06 19:47:34.968670 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:34.968642    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85wvp_8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb/payload-pre-processing/0.log"
Jul 06 19:47:35.015610 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:35.015580    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cj9rx_5b9cb0c6-a3e1-4da6-943c-a30d21a7978d/payload-processing/0.log"
Jul 06 19:47:36.169571 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.169497    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47r54q_759f224f-d6cf-49ca-8c0d-d131c466d457/istio-proxy/0.log"
Jul 06 19:47:36.405557 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.405527    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d5b9884b5-lkmf2_d7a45ef7-9d3d-48f4-b2ed-5331cbdf55e5/kube-auth-proxy/0.log"
Jul 06 19:47:36.425214 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.424520    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/0.log"
Jul 06 19:47:36.464199 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.464169    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4k7r_ea7ef99c-b239-43f3-8add-ebc52c057120/istio-proxy/1.log"
Jul 06 19:47:36.488283 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.488259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-85wvp_8e2142d5-3f98-4ebb-9f56-3f670bb3b8fb/payload-pre-processing/0.log"
Jul 06 19:47:36.540022 ip-10-0-134-25 kubenswrapper[2559]: I0706 19:47:36.539990    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cj9rx_5b9cb0c6-a3e1-4da6-943c-a30d21a7978d/payload-processing/0.log"